-- Logs begin at Tue 2022-10-11 12:47:34 UTC, end at Tue 2022-10-11 13:48:33 UTC. -- Oct 11 13:13:35.073632 dv-cinder-850618-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 11 13:13:35.083299 dv-cinder-850618-5-smb devstack@keystone.service[81388]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 13:13:35 2022] *** Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: nodename: dv-cinder-850618-5-smb Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: machine: x86_64 Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: clock source: unix Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: pcre jit disabled Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: detected number of CPU cores: 4 Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: current working directory: / Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: detected binary path: /usr/bin/uwsgi-core Oct 11 13:13:35.085193 dv-cinder-850618-5-smb devstack@keystone.service[81388]: your processes number limit is 47680 Oct 11 13:13:35.085877 dv-cinder-850618-5-smb devstack@keystone.service[81388]: your memory page size is 4096 bytes Oct 11 13:13:35.085877 dv-cinder-850618-5-smb devstack@keystone.service[81388]: detected max file descriptor number: 2048 Oct 11 13:13:35.085877 dv-cinder-850618-5-smb devstack@keystone.service[81388]: lock engine: pthread robust mutexes Oct 11 13:13:35.085877 dv-cinder-850618-5-smb devstack@keystone.service[81388]: thunder lock: enabled Oct 11 13:13:35.085877 dv-cinder-850618-5-smb devstack@keystone.service[81388]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 11 13:13:35.085877 dv-cinder-850618-5-smb devstack@keystone.service[81388]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 13:13:35.123786 dv-cinder-850618-5-smb devstack@keystone.service[81388]: Python main interpreter initialized at 0x55ba9ab119c0 Oct 11 13:13:35.123786 dv-cinder-850618-5-smb devstack@keystone.service[81388]: python threads support enabled Oct 11 13:13:35.123786 dv-cinder-850618-5-smb devstack@keystone.service[81388]: your server socket listen backlog is limited to 100 connections Oct 11 13:13:35.123786 dv-cinder-850618-5-smb devstack@keystone.service[81388]: your mercy for graceful operations on workers is 90 seconds Oct 11 13:13:35.124145 dv-cinder-850618-5-smb devstack@keystone.service[81388]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 13:13:35.124145 dv-cinder-850618-5-smb devstack@keystone.service[81388]: *** Operational MODE: preforking *** Oct 11 13:13:35.124455 dv-cinder-850618-5-smb devstack@keystone.service[81388]: *** uWSGI is running in multiple interpreter mode *** Oct 11 13:13:35.124455 dv-cinder-850618-5-smb devstack@keystone.service[81388]: spawned uWSGI master process (pid: 81388) Oct 11 13:13:35.124659 dv-cinder-850618-5-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 11 13:13:35.125377 dv-cinder-850618-5-smb devstack@keystone.service[81388]: spawned uWSGI worker 1 (pid: 81400, cores: 1) Oct 11 13:13:35.125483 dv-cinder-850618-5-smb devstack@keystone.service[81388]: spawned uWSGI worker 2 (pid: 81401, cores: 1) Oct 11 13:13:35.127367 dv-cinder-850618-5-smb devstack@keystone.service[81388]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 13:13:39.314755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:13:39.314755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: from cryptography.utils import int_from_bytes Oct 11 13:13:39.315613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:13:39.315613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: from cryptography.utils import int_from_bytes Oct 11 13:13:39.316011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:13:39.316011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: from cryptography.utils import int_from_bytes Oct 11 13:13:39.316117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:13:39.316117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: from cryptography.utils import int_from_bytes Oct 11 13:13:39.364793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:13:39.364994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:13:39.365074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:13:39.365149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:13:39.365214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] command line args: [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:13:39.365276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] command line args: [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:13:39.365408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:13:39.365541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:13:39.365615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ================================================================================ {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:13:39.365680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ================================================================================ {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:13:39.365868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] admin_token = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] admin_token = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] config_dir = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] config_dir = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] config_source = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] config_source = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] debug = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] debug = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.366738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.367936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] list_limit = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] list_limit = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] log_config_append = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] log_config_append = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] log_dir = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] log_dir = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] log_file = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] log_file = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.368954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.369995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.370971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.371804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.372052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.372174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.372499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.372631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.372631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] publish_errors = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.372847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] publish_errors = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.372924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] standard_threads = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.373948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] standard_threads = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] use_journal = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] use_journal = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.374974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] use_json = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] use_json = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] use_stderr = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] use_stderr = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] use_syslog = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] use_syslog = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:13:39.375568 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.375641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.375794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.375930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.376983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377290 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.377931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.378972 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.379930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.380877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.381953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.382986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.383932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.384990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385818 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.385961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.386997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387441 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.387902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.388959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.389882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.390887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.391985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392526 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.392988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.393921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.394900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.395960 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.396968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397349 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.397884 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.398956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.399984 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] auth.external = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] auth.external = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.400977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] auth.password = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] auth.password = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] auth.token = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.401970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] auth.token = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402537 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.402883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] credential.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] credential.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.403963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404290 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.404919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.405936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.406999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.407952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.408896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409124 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.409994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410686 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.410958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.411951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.412892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.413980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.414056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.414540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.414620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.414779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.414910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.415984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.416928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.417948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.418940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419726 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.419960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.420045 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.420187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.420263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.420528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.420603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.420772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.420855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.421951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.422979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.423918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.424848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.425997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.426976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.427908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.428989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.429923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430226 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.430950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.431878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432295 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.432890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433096 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433726 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] role.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.433991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] role.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] role.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] role.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.434956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.435911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.436849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.437947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.438954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.439875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.440934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.441967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442806 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.442905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443543 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.443850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.444942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.445984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.connection = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.connection = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.446982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447371 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.447966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.448997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.449936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.450963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.451037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:13:39.451107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:13:39.451259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:13:39.480241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.480464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.480549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.480702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.480835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.480916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.489070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.489286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.516875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.517074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.517729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.517964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.570962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.571377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.618358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.618640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.619890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.620126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.773516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.773814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.773951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.774923 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.797579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.797839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.798939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.799069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.799138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.799380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.810067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.810638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.822604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.822866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.823939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.824064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.824132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.824354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 13:13:39.840610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.840826 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 13:13:39.841128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.841253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.841320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 13:13:39.841401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 13:13:39.841561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.841687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.841851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.841973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 13:13:39.842054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.842131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.842337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.842459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.842616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.842870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.851875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.852128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.852396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.852521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.852677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.852822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.852999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.853281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.859648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.860316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.862514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.862800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.863180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.863304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.863462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.863587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.863722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.863815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.863983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.864075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.864273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.864418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.864528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.864618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.864818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.864945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.865055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.865143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.865352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.865477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.865607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.865875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.888043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.888679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.889482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.889766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.890144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.890428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.894401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.894661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.894993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.895115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.895375 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.895632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.901331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.901612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.902157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.902444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.907198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.907472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.907786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.908070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.908191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.908319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.908411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.908632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.908760 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.908875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.908978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.909167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.909293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.909462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.909739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.910012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.924915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.925196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.925891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.926178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.928991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.930021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.932242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.932548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.933442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.933741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.936720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.937960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.939776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.941133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.942940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.943236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.943522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.943807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.944083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.944353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.944544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.944639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.944959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.945243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.945524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.945791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.959878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.960160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.960425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.960690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.961613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.961902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.962181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.962442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.967572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.969089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.969480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.970595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.970871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.970992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.972551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.972832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.973586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.973875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.974158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.974440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.974851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.975532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.975815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.976098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.976378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.976760 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.985906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.986190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.986469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.986744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.987141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.987437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.987715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.987968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:39.988246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.988529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.988811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.989172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.989453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:39.989733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.002961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.005149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.005845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.008074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.008724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.010308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.011171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.012360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.012614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.012737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.013028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.014082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.014364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.014762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.019311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.020752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.021097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.022545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.023706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.024098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.024381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.024662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.025588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.026013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.026309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.026586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.032467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.032755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.033001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.034395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.034689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.034992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.040176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.040460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.040727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.041012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.041475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.041612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.041882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.042163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.042318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 13:13:40.042415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.042507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.042689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.042854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.042955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.043069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.043240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.043381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.043464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.043632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.043758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.043886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.044173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.044452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.044720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.045007 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.045267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.045557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.045820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 13:13:40.077600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba9ab119c0 pid: 81400 (default app) Oct 11 13:13:40.079722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba9ab119c0 pid: 81401 (default app) Oct 11 13:13:40.080837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04323e8c-91fb-4dac-a18c-a8e7a7309e34 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:40.081120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04323e8c-91fb-4dac-a18c-a8e7a7309e34 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:40.081385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04323e8c-91fb-4dac-a18c-a8e7a7309e34 None None] PATH_INFO: `/v3` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:40.085582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Tue Oct 11 13:13:40 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:46.795439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ff56-2ea3-4c08-8979-1afb539518f1 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:46.796261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ff56-2ea3-4c08-8979-1afb539518f1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:46.796397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ff56-2ea3-4c08-8979-1afb539518f1 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:46.803499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:46.809447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:46.809906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:46.810041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:46.879520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: INFO dbcounter [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] Registered counter for database keystone Oct 11 13:13:46.900612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG oslo_db.sqlalchemy.engines [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:13:46.912754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writer thread running {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:13:47.105306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG passlib.handlers.bcrypt [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81400) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 11 13:13:47.105607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG passlib.handlers.bcrypt [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81400) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 11 13:13:47.165220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:47.167114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:47.305659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 11 13:13:47.602567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2ff56-2ea3-4c08-8979-1afb539518f1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:47.674663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: INFO dbcounter [None req-72b2ff56-2ea3-4c08-8979-1afb539518f1 None None] Registered counter for database keystone Oct 11 13:13:47.699179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG oslo_db.sqlalchemy.engines [None req-72b2ff56-2ea3-4c08-8979-1afb539518f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:13:47.710657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writer thread running {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:13:47.836691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2ff56-2ea3-4c08-8979-1afb539518f1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:47.845331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a743a-1961-4a2c-ba57-f09ff1ad1bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:47.846279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a743a-1961-4a2c-ba57-f09ff1ad1bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:47.846630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a743a-1961-4a2c-ba57-f09ff1ad1bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:47.846992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a743a-1961-4a2c-ba57-f09ff1ad1bbb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:47.861754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a743a-1961-4a2c-ba57-f09ff1ad1bbb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:47.916083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING keystone.common.rbac_enforcer.enforcer [None req-880a743a-1961-4a2c-ba57-f09ff1ad1bbb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 11 13:13:47.916420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a743a-1961-4a2c-ba57-f09ff1ad1bbb admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:47.926700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Oct 11 13:13:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 13:13:47.934096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:47.962631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc6837-4a95-48d1-89e2-f49ea19b1fd6 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:47.969526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6aa48-39ba-44be-864f-f1e40f20c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:47.970649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6aa48-39ba-44be-864f-f1e40f20c22f admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:47.970959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6aa48-39ba-44be-864f-f1e40f20c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:47.971228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6aa48-39ba-44be-864f-f1e40f20c22f admin admin] PATH_INFO: `/v3/projects/d012bcb449c3476b9eaca11563904099` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:47.973047 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6aa48-39ba-44be-864f-f1e40f20c22f admin admin] RBAC: Authorizing `identity:get_project(project_id=d012bcb449c3476b9eaca11563904099)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:48.025876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fab6aa48-39ba-44be-864f-f1e40f20c22f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 11 13:13:48.026230 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6aa48-39ba-44be-864f-f1e40f20c22f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:48.030959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Oct 11 13:13:47 2022] GET /identity/v3/projects/d012bcb449c3476b9eaca11563904099 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:50.124289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a98188-2f3b-4623-a707-ee434968c89d None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:50.125113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a98188-2f3b-4623-a707-ee434968c89d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:50.125113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a98188-2f3b-4623-a707-ee434968c89d None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:50.132011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:50.138898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8359-4157-480b-bc63-fa07c7e420cb None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:50.139289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8359-4157-480b-bc63-fa07c7e420cb None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:50.139489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8359-4157-480b-bc63-fa07c7e420cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:50.166784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-428f8359-4157-480b-bc63-fa07c7e420cb None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:50.168428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-428f8359-4157-480b-bc63-fa07c7e420cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:50.177901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 13:13:50.444113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a98188-2f3b-4623-a707-ee434968c89d None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:50.465533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a98188-2f3b-4623-a707-ee434968c89d None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:50.471396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f402d0f-e3b0-4137-ac4e-4e526f3d0b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:50.472004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402d0f-e3b0-4137-ac4e-4e526f3d0b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:50.472287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402d0f-e3b0-4137-ac4e-4e526f3d0b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:50.472562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402d0f-e3b0-4137-ac4e-4e526f3d0b1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:50.480952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f402d0f-e3b0-4137-ac4e-4e526f3d0b1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:50.482730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f402d0f-e3b0-4137-ac4e-4e526f3d0b1d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:50.492285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Oct 11 13:13:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:13:50.502780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f8359-4157-480b-bc63-fa07c7e420cb None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:50.514243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f8359-4157-480b-bc63-fa07c7e420cb None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:50.519838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0153154-8f73-42d6-950b-1e1b09a1c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:50.520468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153154-8f73-42d6-950b-1e1b09a1c79c admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:50.520765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153154-8f73-42d6-950b-1e1b09a1c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:50.521037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153154-8f73-42d6-950b-1e1b09a1c79c admin admin] PATH_INFO: `/v3/users/276e27aa2b5a4894a4b0e62293da73e5` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:50.522401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0153154-8f73-42d6-950b-1e1b09a1c79c admin admin] RBAC: Authorizing `identity:get_user(user_id=276e27aa2b5a4894a4b0e62293da73e5)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:50.524273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0153154-8f73-42d6-950b-1e1b09a1c79c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:50.525851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Tue Oct 11 13:13:50 2022] GET /identity/v3/users/276e27aa2b5a4894a4b0e62293da73e5 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:52.672864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc7a0b-7897-4cc8-aa63-b1b9db56f4d0 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:52.673360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc7a0b-7897-4cc8-aa63-b1b9db56f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:52.673360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc7a0b-7897-4cc8-aa63-b1b9db56f4d0 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:52.674790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:52.680071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e2f8a-b28f-4a6b-a913-9a30913f1b5c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:52.680497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e2f8a-b28f-4a6b-a913-9a30913f1b5c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:52.680581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e2f8a-b28f-4a6b-a913-9a30913f1b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:52.699884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1a1e2f8a-b28f-4a6b-a913-9a30913f1b5c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:52.701075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a1e2f8a-b28f-4a6b-a913-9a30913f1b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:52.754590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515e75-d673-4616-8095-78329dc81bd3 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:52.754905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515e75-d673-4616-8095-78329dc81bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:52.755208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515e75-d673-4616-8095-78329dc81bd3 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:52.757455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:52.763578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:52.763862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:52.764173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:52.789383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:13:52.815329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG passlib.handlers.bcrypt [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81401) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 11 13:13:52.816469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG passlib.handlers.bcrypt [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81401) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 11 13:13:52.876034 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:52.877650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:52.985090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:13:53.053506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e2f8a-b28f-4a6b-a913-9a30913f1b5c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.080550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:53.165646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e2f8a-b28f-4a6b-a913-9a30913f1b5c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.201772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.202414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.202691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.202992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.215132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:13:53.223950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:13:53.224883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.225691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:13:53.231516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.258072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.351408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e1f0-6a9b-4a31-9bfd-1b9ec593117a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.351638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:53.354465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:53.372283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b24d-66aa-478c-888e-5a9340a6f6d6 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.396651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.397527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.397826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.398095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.398984 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:13:53.399299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:53.400818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:53.408500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.409147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.409400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.409666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.410351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:53.411863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:53.413444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:53.424392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.426619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.sql.core [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 13:13:53.426619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 13:13:53.426619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [parameters: {'id': '149385856d35438dac74e81cd0dfc747', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 13:13:53.426619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81400) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:13:53.447528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application result.read() Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 13:13:53.448415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application yield resource Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise self.value Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application session.commit() Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 13:13:53.449308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self.session.flush() Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application compat.raise_( Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 13:13:53.450093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:13:53.450950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application result.read() Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:13:53.452217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [parameters: {'id': '149385856d35438dac74e81cd0dfc747', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 13:13:53.453427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:13:53.455012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1137 bytes} [Tue Oct 11 13:13:53 2022] POST /identity/v3/domains => generated 190 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:13:53.456185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.537058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255f20c-ed64-49da-9a9b-93377ff1513b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.561262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8237-5516-4ed1-997c-e93f6145d1a7 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.574020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.574924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.575182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.575472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] PATH_INFO: `/v3/users/276e27aa2b5a4894a4b0e62293da73e5` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.576988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] RBAC: Authorizing `identity:get_user(user_id=276e27aa2b5a4894a4b0e62293da73e5)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:53.578434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:53.580066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:13:53 2022] GET /identity/v3/users/276e27aa2b5a4894a4b0e62293da73e5 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:13:53.585588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.598620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.599296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.599574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.599882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.610231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:53.611745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:53.618703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:53.619781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:13:53.628222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:13:53.629507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:13:53.630268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:13:53.630268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:13:53.630268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:53.630268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:13:53.636981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.690056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f31c4d-e378-4451-8bb6-f7101dfd337a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.723751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.724391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.724667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.724938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.726100 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:53.727576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:53.729183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:13:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:13:53.734877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:53.740103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41b776-8e64-4d31-853e-3948d37e3cc1 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.774229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b25ee0-49ff-4a14-97dd-2c6fd9035ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.774859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25ee0-49ff-4a14-97dd-2c6fd9035ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.775173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25ee0-49ff-4a14-97dd-2c6fd9035ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.775445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25ee0-49ff-4a14-97dd-2c6fd9035ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.776082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b25ee0-49ff-4a14-97dd-2c6fd9035ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:13:53.776377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b25ee0-49ff-4a14-97dd-2c6fd9035ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:53.777759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b25ee0-49ff-4a14-97dd-2c6fd9035ed8 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:53.795962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:13:53.837113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1871e43-afab-4e68-bea6-66352cbf34f8 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:53.839038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:53.875634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144afc3f-5797-4563-a14c-676ae3b29930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:53.876348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144afc3f-5797-4563-a14c-676ae3b29930 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:53.876630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144afc3f-5797-4563-a14c-676ae3b29930 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:53.876909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144afc3f-5797-4563-a14c-676ae3b29930 None admin] PATH_INFO: `/v3/domains/default/users/276e27aa2b5a4894a4b0e62293da73e5/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:53.879030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144afc3f-5797-4563-a14c-676ae3b29930 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=276e27aa2b5a4894a4b0e62293da73e5, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:53.880525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144afc3f-5797-4563-a14c-676ae3b29930 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:54.000344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1361 bytes} [Tue Oct 11 13:13:53 2022] PUT /identity/v3/domains/default/users/276e27aa2b5a4894a4b0e62293da73e5/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:13:56.408785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bcc82-db82-4999-97bf-b604cbbe4c8f None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.409288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bcc82-db82-4999-97bf-b604cbbe4c8f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.409357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bcc82-db82-4999-97bf-b604cbbe4c8f None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.410651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:56.417334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f8ed-7e98-4e92-9d44-bc8308244f9e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.418256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f8ed-7e98-4e92-9d44-bc8308244f9e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.418726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f8ed-7e98-4e92-9d44-bc8308244f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.440682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-86c4f8ed-7e98-4e92-9d44-bc8308244f9e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:56.442654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-86c4f8ed-7e98-4e92-9d44-bc8308244f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:56.520359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:13:56.675520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9d56-d630-4d2c-b4f5-f6233afcf3df None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.676134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9d56-d630-4d2c-b4f5-f6233afcf3df None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.676610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9d56-d630-4d2c-b4f5-f6233afcf3df None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.678293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:56.682083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76de5-ebc3-4bbd-919f-adf1bacd2d95 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.682600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76de5-ebc3-4bbd-919f-adf1bacd2d95 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.684135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7bdc5-b512-4cca-a954-ebeb22d8e694 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.684627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7bdc5-b512-4cca-a954-ebeb22d8e694 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.685126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7bdc5-b512-4cca-a954-ebeb22d8e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.688596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76de5-ebc3-4bbd-919f-adf1bacd2d95 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.697409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:56 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:56.708305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc5a7-b165-44a1-8165-0c7d33cb14e7 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.708589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc5a7-b165-44a1-8165-0c7d33cb14e7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.708871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc5a7-b165-44a1-8165-0c7d33cb14e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.714410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bca7bdc5-b512-4cca-a954-ebeb22d8e694 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:56.715868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bca7bdc5-b512-4cca-a954-ebeb22d8e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:56.736449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-0c7cc5a7-b165-44a1-8165-0c7d33cb14e7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:56.736449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0c7cc5a7-b165-44a1-8165-0c7d33cb14e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:56.804989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:56.828904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:13:56.830177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aba14e-e759-44db-8b66-9f5b13f05591 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.830460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aba14e-e759-44db-8b66-9f5b13f05591 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.830730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aba14e-e759-44db-8b66-9f5b13f05591 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.833571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:56.840039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a173a4-fea7-4600-8285-fd92fde1af20 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:56.840319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a173a4-fea7-4600-8285-fd92fde1af20 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:56.840601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a173a4-fea7-4600-8285-fd92fde1af20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:56.849781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:13:56.868637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-54a173a4-fea7-4600-8285-fd92fde1af20 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:56.869974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-54a173a4-fea7-4600-8285-fd92fde1af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:56.896515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cc5a7-b165-44a1-8165-0c7d33cb14e7 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:56.921665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:56.989310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:13:57.000580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cc5a7-b165-44a1-8165-0c7d33cb14e7 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:57.035357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:57.036270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:57.036732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:57.037167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:57.049143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:13:57.058132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:13:57.058971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:13:57.059755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:13:57.061605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:13:57.080806 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a173a4-fea7-4600-8285-fd92fde1af20 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:57.213118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:57.226566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a173a4-fea7-4600-8285-fd92fde1af20 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:57.253405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:57.282985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faec47-d858-438a-a320-471753fef000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:57.282985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faec47-d858-438a-a320-471753fef000 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:57.282985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faec47-d858-438a-a320-471753fef000 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:57.282985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faec47-d858-438a-a320-471753fef000 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:57.283413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faec47-d858-438a-a320-471753fef000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:13:57.283413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faec47-d858-438a-a320-471753fef000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:57.284254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faec47-d858-438a-a320-471753fef000 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:57.301432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:57.302039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faec47-d858-438a-a320-471753fef000 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:57.348138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:57.360689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c7ebc-ae56-4185-b7e9-2062e1d1424e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:57.413266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:57.414558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:57.415079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:57.415532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:57.416709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:57.418503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:57.450852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 16/32] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Oct 11 13:13:57 2022] POST /identity/v3/roles => generated 219 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:13:57.452083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:57.508922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faec47-d858-438a-a320-471753fef000 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:57.586494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:57.588138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:57.589918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:57.590423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:57.614872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:57.618108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:57.626229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37b354-ecf4-4c9e-8f1d-17e9279fea3d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:13:57.646540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:13:57.647496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:13:57.648251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:13:57.648251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:13:57.648251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:13:57.648251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:13:57.648879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:57.675465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:57.676545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:57.677011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:57.677466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] PATH_INFO: `/v3/users/276e27aa2b5a4894a4b0e62293da73e5` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:57.679122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] RBAC: Authorizing `identity:get_user(user_id=276e27aa2b5a4894a4b0e62293da73e5)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:57.681643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:57.683724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:13:57 2022] GET /identity/v3/users/276e27aa2b5a4894a4b0e62293da73e5 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:57.684845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:57.687638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:57.701791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:57.772406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e5175-bbe0-4b54-b684-9d49d393df3b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:57.808510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb1c7-8c60-4f9c-993a-16d8e65f15b9 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:57.813947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:57.814643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:57.815012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:57.815351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:57.816163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:57.817734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:57.848621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:57.849603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:57.850095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:57.850554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:57.851458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:13:57.852023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:57.853744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:57.878344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 18/35] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:57.879779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:57.951442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:57.957306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Oct 11 13:13:57 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:13:57.958344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:58.009748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a679-74be-416a-a07f-562af22598e3 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:58.052875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c388-f374-4168-9826-e26bd7b9381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:58.053566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c388-f374-4168-9826-e26bd7b9381d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.053855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c388-f374-4168-9826-e26bd7b9381d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.054134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c388-f374-4168-9826-e26bd7b9381d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.055514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c388-f374-4168-9826-e26bd7b9381d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:58.057682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c388-f374-4168-9826-e26bd7b9381d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:58.060409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 19/37] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:58.061791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23977e01-8f37-4b35-8f8f-cf45c9aa3458 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.062079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23977e01-8f37-4b35-8f8f-cf45c9aa3458 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.062358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23977e01-8f37-4b35-8f8f-cf45c9aa3458 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.063968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 20/38] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:58.069729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23977e01-8f37-4b35-8f8f-cf45c9aa3458 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:58.202325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23977e01-8f37-4b35-8f8f-cf45c9aa3458 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:58.210368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:58.221195 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7fc42-f4c4-4cc1-ae73-fa10044a5c80 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:58.242909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3695c20-493a-4341-a76a-eed1baddac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:58.242909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3695c20-493a-4341-a76a-eed1baddac19 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.242909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3695c20-493a-4341-a76a-eed1baddac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.243251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3695c20-493a-4341-a76a-eed1baddac19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.243734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3695c20-493a-4341-a76a-eed1baddac19 None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.domain.id=default, user.id=276e27aa2b5a4894a4b0e62293da73e5) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:13:58.244037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3695c20-493a-4341-a76a-eed1baddac19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:58.245911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3695c20-493a-4341-a76a-eed1baddac19 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:58.255479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 21/39] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Oct 11 13:13:58 2022] GET /identity/v3/role_assignments?user.id=276e27aa2b5a4894a4b0e62293da73e5&scope.domain.id=default&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 530 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:58.256457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d23a8-a9a2-457b-aee7-ab041d756232 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.256737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d23a8-a9a2-457b-aee7-ab041d756232 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.257006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d23a8-a9a2-457b-aee7-ab041d756232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.260576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1e9c0-4aae-4a0f-8b83-99faf0943ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:58.261203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e9c0-4aae-4a0f-8b83-99faf0943ce4 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.261482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e9c0-4aae-4a0f-8b83-99faf0943ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.261753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e9c0-4aae-4a0f-8b83-99faf0943ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.262405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1e9c0-4aae-4a0f-8b83-99faf0943ce4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:58.264103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1e9c0-4aae-4a0f-8b83-99faf0943ce4 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:58.275242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:58.277326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-de6d23a8-a9a2-457b-aee7-ab041d756232 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:58.279072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-de6d23a8-a9a2-457b-aee7-ab041d756232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:58.300127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:13:57 2022] POST /identity/v3/projects => generated 301 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:13:58.302314 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3b0d-1673-44ab-be63-7e30da02c0e8 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.302757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3b0d-1673-44ab-be63-7e30da02c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.303706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3b0d-1673-44ab-be63-7e30da02c0e8 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.305278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:13:58.313865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b41f-e03b-4c52-8597-07ca3d537681 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.314933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b41f-e03b-4c52-8597-07ca3d537681 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.315361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b41f-e03b-4c52-8597-07ca3d537681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.341149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7483b41f-e03b-4c52-8597-07ca3d537681 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:13:58.343204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7483b41f-e03b-4c52-8597-07ca3d537681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:13:58.384187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:13:58.445901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:13:58.648685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d23a8-a9a2-457b-aee7-ab041d756232 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:58.709155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483b41f-e03b-4c52-8597-07ca3d537681 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:58.752940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d23a8-a9a2-457b-aee7-ab041d756232 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:58.781450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:58.784849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:13:58.787948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:58.788641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.789246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.789534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.790207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:58.791858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:58.807668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Oct 11 13:13:58 2022] POST /identity/v3/roles => generated 223 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:13:58.812755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483b41f-e03b-4c52-8597-07ca3d537681 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:58.852775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7d1c4-8622-4bbf-abc9-cd2e9351de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:58.853520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7d1c4-8622-4bbf-abc9-cd2e9351de2d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:58.853797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7d1c4-8622-4bbf-abc9-cd2e9351de2d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:58.854072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7d1c4-8622-4bbf-abc9-cd2e9351de2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:58.855251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7d1c4-8622-4bbf-abc9-cd2e9351de2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:58.856762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7d1c4-8622-4bbf-abc9-cd2e9351de2d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:58.858419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:13:58.864369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:13:58.971107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c773-111a-4dd5-8c28-2eac6a9b03f0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:13:59.006689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691d5c-fbec-4aad-9c63-24a0c511196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:13:59.007363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691d5c-fbec-4aad-9c63-24a0c511196a None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:13:59.007642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691d5c-fbec-4aad-9c63-24a0c511196a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:13:59.007909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691d5c-fbec-4aad-9c63-24a0c511196a None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:13:59.008571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691d5c-fbec-4aad-9c63-24a0c511196a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:13:59.010235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691d5c-fbec-4aad-9c63-24a0c511196a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:13:59.045607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:13:58 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:01.142261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a96770-f784-4306-8314-de60636c7868 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:01.143077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a96770-f784-4306-8314-de60636c7868 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:01.143077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a96770-f784-4306-8314-de60636c7868 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:01.145310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:01.154353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e17d-cd7d-4802-8927-797ff7fa8a1c None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:01.154746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e17d-cd7d-4802-8927-797ff7fa8a1c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:01.155019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e17d-cd7d-4802-8927-797ff7fa8a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:01.180181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-bab6e17d-cd7d-4802-8927-797ff7fa8a1c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:01.181416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bab6e17d-cd7d-4802-8927-797ff7fa8a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:01.224733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:01.253283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:01.517734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a96770-f784-4306-8314-de60636c7868 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:01.636076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a96770-f784-4306-8314-de60636c7868 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:01.677573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcdaf8-1554-4e37-aacd-143921c928b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:01.678274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcdaf8-1554-4e37-aacd-143921c928b9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:01.678551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcdaf8-1554-4e37-aacd-143921c928b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:01.678855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcdaf8-1554-4e37-aacd-143921c928b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:01.680004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcdaf8-1554-4e37-aacd-143921c928b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:01.681815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcdaf8-1554-4e37-aacd-143921c928b9 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:01.683412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:01.692368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e17d-cd7d-4802-8927-797ff7fa8a1c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:01.802110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e17d-cd7d-4802-8927-797ff7fa8a1c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:01.839409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1d46e-5920-4115-8068-b9328b89361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:01.840013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1d46e-5920-4115-8068-b9328b89361f None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:01.840291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1d46e-5920-4115-8068-b9328b89361f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:01.840562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1d46e-5920-4115-8068-b9328b89361f None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:01.841219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1d46e-5920-4115-8068-b9328b89361f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:01.842702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1d46e-5920-4115-8068-b9328b89361f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:01.873150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Oct 11 13:14:01 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:03.970615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370bfb3-d126-4e9a-a19b-e3a54439922d None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:03.971484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370bfb3-d126-4e9a-a19b-e3a54439922d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:03.971484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370bfb3-d126-4e9a-a19b-e3a54439922d None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:03.973606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 25/51] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:03.981028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14832fe-3a52-432c-a04e-7fd1415cb217 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:03.981403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14832fe-3a52-432c-a04e-7fd1415cb217 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:03.981567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14832fe-3a52-432c-a04e-7fd1415cb217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:04.001286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a14832fe-3a52-432c-a04e-7fd1415cb217 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:04.002481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a14832fe-3a52-432c-a04e-7fd1415cb217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:04.024204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:04.076121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:04.342020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370bfb3-d126-4e9a-a19b-e3a54439922d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:04.357037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:04.467485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370bfb3-d126-4e9a-a19b-e3a54439922d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:04.502228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ad02f-7a57-4c04-898f-4c1aaa877159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:04.502870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ad02f-7a57-4c04-898f-4c1aaa877159 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:04.503181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ad02f-7a57-4c04-898f-4c1aaa877159 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:04.503450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ad02f-7a57-4c04-898f-4c1aaa877159 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:04.504595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ad02f-7a57-4c04-898f-4c1aaa877159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:04.506036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ad02f-7a57-4c04-898f-4c1aaa877159 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:04.507652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:04.513525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14832fe-3a52-432c-a04e-7fd1415cb217 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:04.624741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14832fe-3a52-432c-a04e-7fd1415cb217 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:04.768316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e7eee-1ca5-4a36-ba99-b6861ebfcc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:04.768919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7eee-1ca5-4a36-ba99-b6861ebfcc73 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:04.769200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7eee-1ca5-4a36-ba99-b6861ebfcc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:04.769475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7eee-1ca5-4a36-ba99-b6861ebfcc73 None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:04.770127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e7eee-1ca5-4a36-ba99-b6861ebfcc73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:04.771596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e7eee-1ca5-4a36-ba99-b6861ebfcc73 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:04.799018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 28/54] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:04 2022] POST /identity/v3/users => generated 275 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:08.064021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53590-9400-4681-a4bb-e5966824e39a None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.065023 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53590-9400-4681-a4bb-e5966824e39a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.065513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53590-9400-4681-a4bb-e5966824e39a None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.067094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 27/55] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:08.072584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651f46b-e554-40bf-894a-82ab6f1c4cdb None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.073365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651f46b-e554-40bf-894a-82ab6f1c4cdb None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.073846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651f46b-e554-40bf-894a-82ab6f1c4cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.100490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6651f46b-e554-40bf-894a-82ab6f1c4cdb None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:08.102005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6651f46b-e554-40bf-894a-82ab6f1c4cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:08.113589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:08.204076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 29/56] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:08.257332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb877e1-ca1c-4761-bf94-c7e72c35abe8 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.257332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb877e1-ca1c-4761-bf94-c7e72c35abe8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.257332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb877e1-ca1c-4761-bf94-c7e72c35abe8 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.257332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 28/57] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:08.263806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffad57-0dc2-417a-8626-da8863bc19db None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.264149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffad57-0dc2-417a-8626-da8863bc19db None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.264427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffad57-0dc2-417a-8626-da8863bc19db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.288459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3fffad57-0dc2-417a-8626-da8863bc19db None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:08.290111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3fffad57-0dc2-417a-8626-da8863bc19db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:08.378877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:08.427436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907f6c9-c39a-482b-ac4b-ebbdbe47cba5 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.427718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907f6c9-c39a-482b-ac4b-ebbdbe47cba5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.427991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907f6c9-c39a-482b-ac4b-ebbdbe47cba5 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.429326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 29/59] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:08.434972 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48394ac-2044-49e1-9d7a-c968d8146148 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.435262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48394ac-2044-49e1-9d7a-c968d8146148 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.435535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48394ac-2044-49e1-9d7a-c968d8146148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.441216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339b01-3c3e-4a6d-95a4-87449695d639 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.441500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339b01-3c3e-4a6d-95a4-87449695d639 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.441772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339b01-3c3e-4a6d-95a4-87449695d639 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.443223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 30/60] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:14:08.455042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca012d0-cd37-4b32-804c-91e8314aad43 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.455318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca012d0-cd37-4b32-804c-91e8314aad43 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.455588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca012d0-cd37-4b32-804c-91e8314aad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.473762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e48394ac-2044-49e1-9d7a-c968d8146148 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:08.479434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e48394ac-2044-49e1-9d7a-c968d8146148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:08.482360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1ca012d0-cd37-4b32-804c-91e8314aad43 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:08.483565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1ca012d0-cd37-4b32-804c-91e8314aad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:08.550804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 31/61] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:08.576616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca012d0-cd37-4b32-804c-91e8314aad43 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:08.611272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:08.616617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:08.699304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca012d0-cd37-4b32-804c-91e8314aad43 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:08.737667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:08.738650 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.739112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.739535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.750095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:08.755339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:08.756337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:08.757253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:08.759315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 32/63] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:08.767885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48394ac-2044-49e1-9d7a-c968d8146148 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:08.775257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:08.798427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:08.885936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:08.923410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f48962-7135-4ad3-bbb8-97c8220b77db None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:08.947893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48394ac-2044-49e1-9d7a-c968d8146148 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:08.967310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0563e-9dca-405c-9c80-39cb2af429be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:08.967952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0563e-9dca-405c-9c80-39cb2af429be None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.968345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0563e-9dca-405c-9c80-39cb2af429be None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.968619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0563e-9dca-405c-9c80-39cb2af429be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.984592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0563e-9dca-405c-9c80-39cb2af429be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:08.985733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:08.986362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.986664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.986970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.987652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:08.987958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:08.989350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-0ab0563e-9dca-405c-9c80-39cb2af429be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:08.989501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:08.990303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:08.991077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 33/64] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:08.991791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319330ad-310a-425f-89b8-d43786453478 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:08.992064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319330ad-310a-425f-89b8-d43786453478 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:08.992332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319330ad-310a-425f-89b8-d43786453478 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:08.994346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 34/65] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:08.995017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319330ad-310a-425f-89b8-d43786453478 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.007167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 32/66] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.008026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.082618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.108293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319330ad-310a-425f-89b8-d43786453478 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.120997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74849d09-df97-4db2-a074-bb26289c7f46 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.134469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.142709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.143321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.143608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.143884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.155088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:09.156118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875b006-3cac-4d1f-bf2a-2ed9630d7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.156749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b006-3cac-4d1f-bf2a-2ed9630d7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.157026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b006-3cac-4d1f-bf2a-2ed9630d7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.157296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b006-3cac-4d1f-bf2a-2ed9630d7fb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:09.159980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:09.160822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:09.161554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 35/67] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:09.162602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.171635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875b006-3cac-4d1f-bf2a-2ed9630d7fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-c875b006-3cac-4d1f-bf2a-2ed9630d7fb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:09.176456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:09.177516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:09.178465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 33/68] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:09.179977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a4ea1-70c8-46a1-b7a9-743edc7f0e14 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.179977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a4ea1-70c8-46a1-b7a9-743edc7f0e14 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.179977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a4ea1-70c8-46a1-b7a9-743edc7f0e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.196955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d26a4ea1-70c8-46a1-b7a9-743edc7f0e14 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:09.198781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d26a4ea1-70c8-46a1-b7a9-743edc7f0e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:09.265327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131fbbf-0172-4de2-9150-3dc0089c867e None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.266574 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:09.278931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a4ea1-70c8-46a1-b7a9-743edc7f0e14 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.315545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.316159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.316551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.316828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.317612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:09.317919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.319432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.323437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.333704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.333704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.381415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a4ea1-70c8-46a1-b7a9-743edc7f0e14 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.388640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.419145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.419755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.420044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.420675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] PATH_INFO: `/v3/users/0e353a37c7654e15b9756130a532656e` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.437486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] RBAC: Authorizing `identity:get_user(user_id=0e353a37c7654e15b9756130a532656e)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.439036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.445037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/users/0e353a37c7654e15b9756130a532656e => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.445037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.450018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a34a5-ced8-4571-b937-4caf73a9e601 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.486487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.487139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.487421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.487700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.488396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] RBAC: Adding query filter params (name=member) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:09.488706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.490101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.503532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.503532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.545767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c95959-7542-4be5-ae08-2db61559ceb1 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.558581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.579283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.579891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.580169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.580440 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.581095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:09.581396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.582785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.590707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.591523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.601396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5abf-ac4b-4450-942a-44c109bd8923 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.614429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.635982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.636620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.636907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.637181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] PATH_INFO: `/v3/users/276e27aa2b5a4894a4b0e62293da73e5` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.638330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] RBAC: Authorizing `identity:get_user(user_id=276e27aa2b5a4894a4b0e62293da73e5)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.639847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.641436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/users/276e27aa2b5a4894a4b0e62293da73e5 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.642198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.691528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b127e9-1097-4d3a-8f6e-431ca74929fe None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.724271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.724909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.725189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.725473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.726622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.728364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.730037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.730805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.744334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2504d-4fa1-4cfa-a1d2-a986596ae365 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.772722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.778944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.779590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.779871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.780152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] PATH_INFO: `/v3/users/0e353a37c7654e15b9756130a532656e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.781334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] RBAC: Authorizing `identity:get_user(user_id=0e353a37c7654e15b9756130a532656e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.782803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.785930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/users/0e353a37c7654e15b9756130a532656e => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.786701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.831374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca086e-90ad-47de-8979-fa5d81037581 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.839217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:09.865579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.866206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.866478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.866744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.867979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.869604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.871374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.871952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.892003 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600599-2163-44a0-a8a2-32ea63f9e109 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.925665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:09.926294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:09.926571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:09.926864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] PATH_INFO: `/v3/users/0e353a37c7654e15b9756130a532656e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:09.928015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] RBAC: Authorizing `identity:get_user(user_id=0e353a37c7654e15b9756130a532656e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:09.929478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:09.931200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/users/0e353a37c7654e15b9756130a532656e => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:09.932015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:09.970913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e22c06-410a-4de9-b8f5-bb718bbd04af None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:09.981288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:10.004502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.005218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.005495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.005761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.006898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.008359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.010151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:09 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:10.010956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:10.028847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec875017-a812-4015-94a3-2c949fa8f7aa None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:10.044742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:10.062626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.063326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.063605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.063864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c/users/0e353a37c7654e15b9756130a532656e/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.065757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dc85f61719445e9848876aff636e33c, user_id=0e353a37c7654e15b9756130a532656e, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.067230 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.081160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:09 2022] PUT /identity/v3/projects/6dc85f61719445e9848876aff636e33c/users/0e353a37c7654e15b9756130a532656e/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:10.081956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:10.121232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e4eb-9df8-4dd3-9ed8-573337832589 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:10.161972 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.162676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.163129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.163420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] PATH_INFO: `/v3/projects/1c231f10fea2485aa16d52bb3bdd4bef` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.165065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] RBAC: Authorizing `identity:get_project(project_id=1c231f10fea2485aa16d52bb3bdd4bef)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.166735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.173517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 40/81] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:10 2022] GET /identity/v3/projects/1c231f10fea2485aa16d52bb3bdd4bef => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:10.173517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:10.200990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902b185-5ebe-4aac-825d-0d047c48f003 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:10.231672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:10.240113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.240897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.241002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.241261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.241951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.243533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.273498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 42/82] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:10 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:10.274339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:10.314333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:10.316872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75b0c6-0dc6-4f02-ae23-31aa51be252c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:10.374485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.375173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.375452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.376169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.377806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.379561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.382060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:10 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:10.383142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:10.401490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3136ad8-0487-48a7-bd27-c9bf86c675fb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:10.449257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.450844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.450844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.450844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c/users/276e27aa2b5a4894a4b0e62293da73e5/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.453143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dc85f61719445e9848876aff636e33c, user_id=276e27aa2b5a4894a4b0e62293da73e5, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.455257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.473534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 43/84] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:10 2022] PUT /identity/v3/projects/6dc85f61719445e9848876aff636e33c/users/276e27aa2b5a4894a4b0e62293da73e5/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:10.474340 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:10.546624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969355e-1ce8-4575-9a4b-750b3b99feea None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:10.564320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:10.592038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84062174-9ef9-4e0d-bfee-28fe6bf0802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.592777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062174-9ef9-4e0d-bfee-28fe6bf0802d None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.593101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062174-9ef9-4e0d-bfee-28fe6bf0802d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.593430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062174-9ef9-4e0d-bfee-28fe6bf0802d None admin] PATH_INFO: `/v3/projects/1c231f10fea2485aa16d52bb3bdd4bef/users/0e353a37c7654e15b9756130a532656e/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.596172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84062174-9ef9-4e0d-bfee-28fe6bf0802d None admin] RBAC: Authorizing `identity:create_grant(project_id=1c231f10fea2485aa16d52bb3bdd4bef, user_id=0e353a37c7654e15b9756130a532656e, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.597728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84062174-9ef9-4e0d-bfee-28fe6bf0802d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.600478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0773b0-ebe5-434a-8aa2-8ed09d91bb78 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:10.603465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:10.616135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 42/85] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:10 2022] PUT /identity/v3/projects/1c231f10fea2485aa16d52bb3bdd4bef/users/0e353a37c7654e15b9756130a532656e/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:10.650141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6e420-fd82-40ba-9619-303eaf0df558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:10.651964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6e420-fd82-40ba-9619-303eaf0df558 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:10.652732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6e420-fd82-40ba-9619-303eaf0df558 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:10.653416 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6e420-fd82-40ba-9619-303eaf0df558 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c/users/0e353a37c7654e15b9756130a532656e/roles/60a9b9055fe947f6adfcc4173f804a58` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:10.656959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6e420-fd82-40ba-9619-303eaf0df558 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dc85f61719445e9848876aff636e33c, user_id=0e353a37c7654e15b9756130a532656e, role_id=60a9b9055fe947f6adfcc4173f804a58)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:10.658904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6e420-fd82-40ba-9619-303eaf0df558 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:10.680189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 44/86] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:10 2022] PUT /identity/v3/projects/6dc85f61719445e9848876aff636e33c/users/0e353a37c7654e15b9756130a532656e/roles/60a9b9055fe947f6adfcc4173f804a58 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:12.665707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd118-ece6-4e74-aa76-c2072e6c0647 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:12.666743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd118-ece6-4e74-aa76-c2072e6c0647 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:12.667253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd118-ece6-4e74-aa76-c2072e6c0647 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:12.668798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 43/87] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:12.673962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135ee4-bfd1-4782-a452-5fc920d350f1 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:12.674741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135ee4-bfd1-4782-a452-5fc920d350f1 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:12.675244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135ee4-bfd1-4782-a452-5fc920d350f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:12.699347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-51135ee4-bfd1-4782-a452-5fc920d350f1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:12.700875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-51135ee4-bfd1-4782-a452-5fc920d350f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:12.779615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:13.301087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dd118-ece6-4e74-aa76-c2072e6c0647 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:13.373399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507ecb-e647-4d0e-9136-b7e280a181d9 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:13.373732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507ecb-e647-4d0e-9136-b7e280a181d9 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:13.373948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507ecb-e647-4d0e-9136-b7e280a181d9 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:13.375497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 46/89] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:14:13.380619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814a292-72db-4975-9fd6-4c702d2b1aef None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:13.380906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814a292-72db-4975-9fd6-4c702d2b1aef None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:13.381247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814a292-72db-4975-9fd6-4c702d2b1aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:13.411929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3814a292-72db-4975-9fd6-4c702d2b1aef None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:13.413233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3814a292-72db-4975-9fd6-4c702d2b1aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:13.464451 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dd118-ece6-4e74-aa76-c2072e6c0647 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:13.513856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:13.514930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:13.515399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:13.515856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:13.532145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:13.537773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:13.538927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:13.539667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:13.548642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:13.554605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:13.559363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 47/91] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:13.602465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:13.686183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfe9be-d85a-4200-9957-a3c119717563 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:13.734590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa153b-74ef-40e9-a513-c550e162cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:13.735677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa153b-74ef-40e9-a513-c550e162cca8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:13.736157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa153b-74ef-40e9-a513-c550e162cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:13.736627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa153b-74ef-40e9-a513-c550e162cca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:13.737597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa153b-74ef-40e9-a513-c550e162cca8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:13.738115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa153b-74ef-40e9-a513-c550e162cca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:13.739894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa153b-74ef-40e9-a513-c550e162cca8 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:13.750532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:13.756792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814a292-72db-4975-9fd6-4c702d2b1aef None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:13.793479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:13.943958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814a292-72db-4975-9fd6-4c702d2b1aef None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:13.991520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f6d7b-929d-45db-80a2-406bc567266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:13.992170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f6d7b-929d-45db-80a2-406bc567266c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:13.992454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f6d7b-929d-45db-80a2-406bc567266c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:13.992728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f6d7b-929d-45db-80a2-406bc567266c None admin] PATH_INFO: `/v3/users/0e353a37c7654e15b9756130a532656e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:13.994286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f6d7b-929d-45db-80a2-406bc567266c None admin] RBAC: Authorizing `identity:get_user(user_id=0e353a37c7654e15b9756130a532656e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:13.995792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f6d7b-929d-45db-80a2-406bc567266c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:13.998735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:13 2022] GET /identity/v3/users/0e353a37c7654e15b9756130a532656e => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:14.002351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6b8d-2b36-44a9-8572-e171b89a599b None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.002804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6b8d-2b36-44a9-8572-e171b89a599b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.003266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6b8d-2b36-44a9-8572-e171b89a599b None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.003936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e7db-46ce-4e0b-bcbc-527b0af0c705 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.004224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e7db-46ce-4e0b-bcbc-527b0af0c705 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.004504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e7db-46ce-4e0b-bcbc-527b0af0c705 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.005217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 46/94] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:14.009354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 49/95] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:14.009497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a6b8d-2b36-44a9-8572-e171b89a599b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.011465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de6b94-627b-445b-8c3b-726d0315058d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.011751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de6b94-627b-445b-8c3b-726d0315058d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.012027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de6b94-627b-445b-8c3b-726d0315058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.038023 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-75de6b94-627b-445b-8c3b-726d0315058d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:14.039549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-75de6b94-627b-445b-8c3b-726d0315058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:14.112893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 50/96] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:14.113974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a973d-c369-4039-aab0-bdd7b72b4afc None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.114259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a973d-c369-4039-aab0-bdd7b72b4afc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.114526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a973d-c369-4039-aab0-bdd7b72b4afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.121450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.129404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a6b8d-2b36-44a9-8572-e171b89a599b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:14.133156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-183a973d-c369-4039-aab0-bdd7b72b4afc None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:14.134579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-183a973d-c369-4039-aab0-bdd7b72b4afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:14.137465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.164904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7edf1-da78-4dcd-a0b5-3f366872f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:14.165671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7edf1-da78-4dcd-a0b5-3f366872f986 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.165838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7edf1-da78-4dcd-a0b5-3f366872f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.166108 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7edf1-da78-4dcd-a0b5-3f366872f986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.218935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 51/97] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:14.218935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e5a89-01cd-4c6b-a0a6-ee400b785fda None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.218935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e5a89-01cd-4c6b-a0a6-ee400b785fda None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.218935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e5a89-01cd-4c6b-a0a6-ee400b785fda None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.218935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 52/98] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:14.218935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe3b87-409f-45e1-91cd-f0a3a8b60e3f None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.218935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe3b87-409f-45e1-91cd-f0a3a8b60e3f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.219515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe3b87-409f-45e1-91cd-f0a3a8b60e3f None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.219515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 53/99] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:14.219515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe3b87-409f-45e1-91cd-f0a3a8b60e3f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.250727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7edf1-da78-4dcd-a0b5-3f366872f986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:14.252224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7edf1-da78-4dcd-a0b5-3f366872f986 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:14.325829 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe3b87-409f-45e1-91cd-f0a3a8b60e3f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:14.348922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.356083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 47/100] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:14.357486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f554-3c8c-4e00-8f8d-2f8320c56576 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.357920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f554-3c8c-4e00-8f8d-2f8320c56576 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.358295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f554-3c8c-4e00-8f8d-2f8320c56576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.363249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc8670-c757-44f2-bbd4-3a6c471e2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:14.363890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8670-c757-44f2-bbd4-3a6c471e2511 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.364164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8670-c757-44f2-bbd4-3a6c471e2511 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.364435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8670-c757-44f2-bbd4-3a6c471e2511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.372733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.376732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc8670-c757-44f2-bbd4-3a6c471e2511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:14.377448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3093f554-3c8c-4e00-8f8d-2f8320c56576 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:14.378807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3093f554-3c8c-4e00-8f8d-2f8320c56576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-89dc8670-c757-44f2-bbd4-3a6c471e2511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:14.382617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:14.383468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:14.384313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 54/101] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:14.389531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441965d-50f7-4d4a-a283-3ddeea407114 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.389531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441965d-50f7-4d4a-a283-3ddeea407114 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.389531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441965d-50f7-4d4a-a283-3ddeea407114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.403405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-9441965d-50f7-4d4a-a283-3ddeea407114 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:14.404579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9441965d-50f7-4d4a-a283-3ddeea407114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:14.450315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 48/102] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:14.451211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f554-3c8c-4e00-8f8d-2f8320c56576 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.484910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 55/103] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:14.485925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441965d-50f7-4d4a-a283-3ddeea407114 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.565447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f554-3c8c-4e00-8f8d-2f8320c56576 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:14.602151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.613710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441965d-50f7-4d4a-a283-3ddeea407114 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:14.614059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:14.614957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.615647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.616086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.618274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:14.620081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:14.622446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 49/104] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:14.623429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.651874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.659516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:14.660511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.661246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.661713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.663250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:14.666065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:14.668020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 56/105] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:14.668986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.743410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1935b-c811-4daf-a7a0-038b7a74c64b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:14.779030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:14.779649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.779933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.780205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.780876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:14.781179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:14.782565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:14.785961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451218d6-fc5b-43d9-bfb1-e6f08abc2f16 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:14.791106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 50/106] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:14.791912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.821655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452805e5-df88-40f8-b328-d81619521bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:14.822319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452805e5-df88-40f8-b328-d81619521bce None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.822604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452805e5-df88-40f8-b328-d81619521bce None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.822913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452805e5-df88-40f8-b328-d81619521bce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.832758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452805e5-df88-40f8-b328-d81619521bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-452805e5-df88-40f8-b328-d81619521bce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:14.838217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:14.839248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:14.840050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 57/107] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:14.840638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452805e5-df88-40f8-b328-d81619521bce None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.848214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.893344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce27a-1bf5-4943-b7e7-a68fc306dd3b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:14.901858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:14.926201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:14.926830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:14.927117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:14.927392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:14.928114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] RBAC: Adding query filter params (role.id=80afb3528aef4ca38d372f9e8ea1c662, scope.project.id=6dc85f61719445e9848876aff636e33c, user.id=0e353a37c7654e15b9756130a532656e) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:14.928420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:14.929844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:14.935723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 51/108] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/role_assignments?user.id=0e353a37c7654e15b9756130a532656e&scope.project.id=6dc85f61719445e9848876aff636e33c&role.id=80afb3528aef4ca38d372f9e8ea1c662 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:14.936499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:14.968878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452805e5-df88-40f8-b328-d81619521bce None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.009066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.009625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.009909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.010184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.010919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.012747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.043236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 58/109] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:14:14 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:15.052766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.054786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a926c-2cdb-425c-81c8-dc20120ca2ec None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.080780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.099112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.100039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.100307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.100648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.115183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:15.122055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:15.123208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:15.124030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 52/110] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:15.124763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.214442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff82561-87a5-473b-8f01-0d8c67b313b6 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.231101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.256748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40368e7-e30b-424e-9fe2-f6213ccda781 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.259300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.259896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.260172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.260440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.270789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:15.275749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:15.276575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:15.277309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 59/111] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:15.277898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.299225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.299868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.300148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.300414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] PATH_INFO: `/v3/users/276e27aa2b5a4894a4b0e62293da73e5` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.301550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] RBAC: Authorizing `identity:get_user(user_id=276e27aa2b5a4894a4b0e62293da73e5)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.303056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.304862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 53/112] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/users/276e27aa2b5a4894a4b0e62293da73e5 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:15.305425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.361857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.393457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ead7-56c2-4e7b-bc17-52e97c19c529 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.419952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427334d-ea1b-4925-993d-8a193408b2ee None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.427834 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.428448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.428725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.428992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.429661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:15.429967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.431534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.440052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 60/113] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:15.443691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.459255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.459873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.460150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.460418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.461076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:15.461376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.462845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.471086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 54/114] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:15.471944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.479160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.557797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae228b2-5947-4d7b-b3a8-3f82d0ad6bbd None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.576720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320581-ef38-4d8b-a806-e0c31f43a0f5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.587535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.599470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.600086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.600366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.600640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.601312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:15.601614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.603235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.615699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 61/115] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:15.615699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.620131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.620768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.621046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.621314 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.693901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.695430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.712018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.720655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4630e3-0b76-4651-8449-4193142cdd2e None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.755909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.756541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.756816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.757086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] PATH_INFO: `/v3/users/0e353a37c7654e15b9756130a532656e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.758404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] RBAC: Authorizing `identity:get_user(user_id=0e353a37c7654e15b9756130a532656e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.760136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.766202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 62/116] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/users/0e353a37c7654e15b9756130a532656e => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:15.766202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.797558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 55/117] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:15.798431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.811422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.871693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a0a2-575d-4e7a-9c8b-f2acb234bd06 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.904645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.905278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.905558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.905777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480526-70db-4c27-a37f-0f2e8a7ff5a0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:15.905873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] PATH_INFO: `/v3/users/f6f1fa8d2d9e4cdb9868ca24f4b63d4b` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.919304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] RBAC: Authorizing `identity:get_user(user_id=f6f1fa8d2d9e4cdb9868ca24f4b63d4b)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.921060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.922735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 63/118] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/users/f6f1fa8d2d9e4cdb9868ca24f4b63d4b => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:15.927935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:15.943183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:15.943873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:15.944147 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:15.944389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] PATH_INFO: `/v3/users/0e353a37c7654e15b9756130a532656e` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:15.945627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=0e353a37c7654e15b9756130a532656e)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:15.947677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:15.954383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 56/119] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/users/0e353a37c7654e15b9756130a532656e => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:15.954560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:15.954634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.033741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536925-2ee2-4da8-b625-1ff99df6df11 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.035007 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.058326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4c17-8825-4ed8-8a02-ffd21461c1a9 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.070203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.070703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.071013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.071367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.094634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.095299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.095582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.095852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.096961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.098404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.100075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 57/120] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:16.100825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.146657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.148359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.170773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.205810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ddc7-0c9a-4a14-a9b9-351a9ffc43a6 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.241625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.242492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.243250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.243526 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.244782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.246318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.248336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:16 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:16.249271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.249657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 64/122] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:16.250676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.272303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.359282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb94a05-6c94-41df-9072-a8da178eb961 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.368614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f215b-71c8-4e90-80ee-79eaa25d51da None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.380553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.399272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.400315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.400599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.401118 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.401843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=6dc85f61719445e9848876aff636e33c, user.id=276e27aa2b5a4894a4b0e62293da73e5) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:16.402150 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.403620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.404697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.405318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.405599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.405873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.412138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 65/123] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:16 2022] GET /identity/v3/role_assignments?user.id=276e27aa2b5a4894a4b0e62293da73e5&scope.project.id=6dc85f61719445e9848876aff636e33c&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:16.413040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.486095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.487656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.504448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.558284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c92a1-2f41-4e65-8e9d-128318df5d82 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.598555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.599177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.599464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.600060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c/users/f6f1fa8d2d9e4cdb9868ca24f4b63d4b/roles/2ce82b71b3ac44ceb433aaa512819a74` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.601858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dc85f61719445e9848876aff636e33c, user_id=f6f1fa8d2d9e4cdb9868ca24f4b63d4b, role_id=2ce82b71b3ac44ceb433aaa512819a74)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.603670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.607004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 59/124] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:16.612646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.626884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 66/125] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:16 2022] PUT /identity/v3/projects/6dc85f61719445e9848876aff636e33c/users/f6f1fa8d2d9e4cdb9868ca24f4b63d4b/roles/2ce82b71b3ac44ceb433aaa512819a74 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:16.627776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.696681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.749981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639824d9-364b-48ae-bf5e-b7f7c70faf65 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.768846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d859c-9321-44dc-8ebe-9a5df36074f0 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.769338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.796717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.797375 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.797651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.798179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] PATH_INFO: `/v3/projects/1c231f10fea2485aa16d52bb3bdd4bef` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.799411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] RBAC: Authorizing `identity:get_project(project_id=1c231f10fea2485aa16d52bb3bdd4bef)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.801084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.803747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 60/126] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:16 2022] GET /identity/v3/projects/1c231f10fea2485aa16d52bb3bdd4bef => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:16.809969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.817395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.818289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.818796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.819236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.820683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.822761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.824846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 67/127] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:16 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:16.831433 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:16.935260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d3878-1248-46c4-97f1-326c3a79dd9b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.950939 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b68d-4bd4-48bd-94e7-7c2c16d046fa None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:16.965634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:16.986464 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5483ce-8fa7-4d26-8821-e7cb46a39399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.987488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5483ce-8fa7-4d26-8821-e7cb46a39399 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.988031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5483ce-8fa7-4d26-8821-e7cb46a39399 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.988316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5483ce-8fa7-4d26-8821-e7cb46a39399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.989336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5483ce-8fa7-4d26-8821-e7cb46a39399 None admin] RBAC: Adding query filter params (role.id=80afb3528aef4ca38d372f9e8ea1c662, scope.project.id=1c231f10fea2485aa16d52bb3bdd4bef, user.id=0e353a37c7654e15b9756130a532656e) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:16.989656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5483ce-8fa7-4d26-8821-e7cb46a39399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.991497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5483ce-8fa7-4d26-8821-e7cb46a39399 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.991732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67528e-a20b-46e3-a320-f45838e26b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:16.992336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67528e-a20b-46e3-a320-f45838e26b8d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:16.992610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67528e-a20b-46e3-a320-f45838e26b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:16.992876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67528e-a20b-46e3-a320-f45838e26b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:16.993753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67528e-a20b-46e3-a320-f45838e26b8d None admin] RBAC: Adding query filter params (role.id=60a9b9055fe947f6adfcc4173f804a58, scope.project.id=6dc85f61719445e9848876aff636e33c, user.id=0e353a37c7654e15b9756130a532656e) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:16.994056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67528e-a20b-46e3-a320-f45838e26b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:16.995529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67528e-a20b-46e3-a320-f45838e26b8d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:16.998048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 61/128] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:16 2022] GET /identity/v3/role_assignments?user.id=0e353a37c7654e15b9756130a532656e&scope.project.id=1c231f10fea2485aa16d52bb3bdd4bef&role.id=80afb3528aef4ca38d372f9e8ea1c662 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:17.007466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 68/129] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:16 2022] GET /identity/v3/role_assignments?user.id=0e353a37c7654e15b9756130a532656e&scope.project.id=6dc85f61719445e9848876aff636e33c&role.id=60a9b9055fe947f6adfcc4173f804a58 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:17.253792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568753-baf8-42b8-86b9-76003b6d9f44 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:17.254076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568753-baf8-42b8-86b9-76003b6d9f44 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:17.254355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568753-baf8-42b8-86b9-76003b6d9f44 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:17.255913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 62/130] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:17.261404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682717-b33e-41fd-80ab-d951b4156bb8 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:17.261694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682717-b33e-41fd-80ab-d951b4156bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:17.261970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682717-b33e-41fd-80ab-d951b4156bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:17.281290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-0a682717-b33e-41fd-80ab-d951b4156bb8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:17.282836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0a682717-b33e-41fd-80ab-d951b4156bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:17.349451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 69/131] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:17.616098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568753-baf8-42b8-86b9-76003b6d9f44 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:17.665281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:17.720265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568753-baf8-42b8-86b9-76003b6d9f44 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:17.754082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e9a59-c3fe-400d-8c71-cc3a1078c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:17.754700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e9a59-c3fe-400d-8c71-cc3a1078c8aa None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:17.755009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e9a59-c3fe-400d-8c71-cc3a1078c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:17.755280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e9a59-c3fe-400d-8c71-cc3a1078c8aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:17.756429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e9a59-c3fe-400d-8c71-cc3a1078c8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:17.757864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e9a59-c3fe-400d-8c71-cc3a1078c8aa None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:17.759507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 63/132] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:17.765153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682717-b33e-41fd-80ab-d951b4156bb8 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:17.865542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682717-b33e-41fd-80ab-d951b4156bb8 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:17.873405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:17.900680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67facf8c-59b5-4774-8a39-b2dce2f3218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:17.901286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67facf8c-59b5-4774-8a39-b2dce2f3218c None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:17.901560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67facf8c-59b5-4774-8a39-b2dce2f3218c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:17.901826 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67facf8c-59b5-4774-8a39-b2dce2f3218c None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:17.902469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67facf8c-59b5-4774-8a39-b2dce2f3218c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:17.903953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67facf8c-59b5-4774-8a39-b2dce2f3218c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:17.927907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 70/133] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:17 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:18.847341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d839ee-b803-4c9d-a0d6-512d72fcf22d None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:18.847861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d839ee-b803-4c9d-a0d6-512d72fcf22d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:18.847861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d839ee-b803-4c9d-a0d6-512d72fcf22d None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:18.849358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 64/134] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:18.854877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df9ea-e94d-426e-9465-93a4fc3fc9c4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:18.855308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df9ea-e94d-426e-9465-93a4fc3fc9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:18.855474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df9ea-e94d-426e-9465-93a4fc3fc9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:18.875367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-371df9ea-e94d-426e-9465-93a4fc3fc9c4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:18.876579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-371df9ea-e94d-426e-9465-93a4fc3fc9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:18.944768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:19.211185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d839ee-b803-4c9d-a0d6-512d72fcf22d None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:19.312047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d839ee-b803-4c9d-a0d6-512d72fcf22d None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:19.334083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:19.349268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:19.349910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:19.350186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:19.350457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:19.361492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:19.366333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:19.367206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:19.368305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 65/136] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:19.373339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df9ea-e94d-426e-9465-93a4fc3fc9c4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:19.464693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:19.474028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df9ea-e94d-426e-9465-93a4fc3fc9c4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:19.508856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:19.509833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:19.510274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:19.510735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:19.511586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:19.512050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:19.513613 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:19.522368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 72/137] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:19.530670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:19.627277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516e170-b074-4aa7-a62e-a9241a00510e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:19.660259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:19.660895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:19.661171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:19.661510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] PATH_INFO: `/v3/users/f6f1fa8d2d9e4cdb9868ca24f4b63d4b` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:19.662685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] RBAC: Authorizing `identity:get_user(user_id=f6f1fa8d2d9e4cdb9868ca24f4b63d4b)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:19.664476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:19.666137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 66/138] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:19 2022] GET /identity/v3/users/f6f1fa8d2d9e4cdb9868ca24f4b63d4b => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:19.671670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:19.773048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ca43f-ad52-4f78-8251-20f9ec9b3f42 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:19.808357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:19.809348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:19.809890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:19.810366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:19.836069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:19.881802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:19.884274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:19.988571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 73/139] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:19.994171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:20.037699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:20.097244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de54c7-9adf-4042-957c-28d682ef64d3 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:20.132851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290110bd-0dce-4975-b169-259506c7f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:20.133620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290110bd-0dce-4975-b169-259506c7f61a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.133895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290110bd-0dce-4975-b169-259506c7f61a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.134162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290110bd-0dce-4975-b169-259506c7f61a None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.135307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290110bd-0dce-4975-b169-259506c7f61a None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:20.136795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290110bd-0dce-4975-b169-259506c7f61a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:20.138431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 67/140] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:19 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:20.144332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:20.205589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:20.212480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4938-5e06-4a28-b257-37dacf9bddac None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.212765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4938-5e06-4a28-b257-37dacf9bddac None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.213038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4938-5e06-4a28-b257-37dacf9bddac None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.214530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 68/141] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:20.220814 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96906157-820b-4712-b800-b3f597da42b0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.221095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96906157-820b-4712-b800-b3f597da42b0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.221480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96906157-820b-4712-b800-b3f597da42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.240475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-96906157-820b-4712-b800-b3f597da42b0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:20.241711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-96906157-820b-4712-b800-b3f597da42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:20.262013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fef6da-b571-46dd-9ae8-4d321e20287c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:20.299935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9725dd-fcef-4110-b8b6-e11d7395b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:20.300677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9725dd-fcef-4110-b8b6-e11d7395b7de None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.301062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9725dd-fcef-4110-b8b6-e11d7395b7de None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.301448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9725dd-fcef-4110-b8b6-e11d7395b7de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.302277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9725dd-fcef-4110-b8b6-e11d7395b7de None admin] RBAC: Adding query filter params (role.id=2ce82b71b3ac44ceb433aaa512819a74, scope.project.id=6dc85f61719445e9848876aff636e33c, user.id=f6f1fa8d2d9e4cdb9868ca24f4b63d4b) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:20.302680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9725dd-fcef-4110-b8b6-e11d7395b7de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:20.304486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9725dd-fcef-4110-b8b6-e11d7395b7de None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:20.311087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 74/142] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:20 2022] GET /identity/v3/role_assignments?user.id=f6f1fa8d2d9e4cdb9868ca24f4b63d4b&scope.project.id=6dc85f61719445e9848876aff636e33c&role.id=2ce82b71b3ac44ceb433aaa512819a74 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:20.317608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 69/143] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:20.373006 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0438d-50ac-4627-b944-581add02fa11 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.373338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0438d-50ac-4627-b944-581add02fa11 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.373560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0438d-50ac-4627-b944-581add02fa11 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.374959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 75/144] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:20.380731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143be2c-a6ef-42eb-a9ba-e9a38ff676c0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.381020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143be2c-a6ef-42eb-a9ba-e9a38ff676c0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.381289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143be2c-a6ef-42eb-a9ba-e9a38ff676c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.401189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d143be2c-a6ef-42eb-a9ba-e9a38ff676c0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:20.402408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d143be2c-a6ef-42eb-a9ba-e9a38ff676c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:20.441960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:20.460941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b5e2-c1a2-4af7-b6af-edbb7fe304f6 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.461270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b5e2-c1a2-4af7-b6af-edbb7fe304f6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.461492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b5e2-c1a2-4af7-b6af-edbb7fe304f6 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.463325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 76/145] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:20.469455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080943-1066-4c24-88be-7be81109a600 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.469741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080943-1066-4c24-88be-7be81109a600 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.470011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080943-1066-4c24-88be-7be81109a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.480803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 70/146] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:20.489671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-fa080943-1066-4c24-88be-7be81109a600 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:20.490921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fa080943-1066-4c24-88be-7be81109a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:20.573146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 77/147] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:20.622448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143be2c-a6ef-42eb-a9ba-e9a38ff676c0 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:20.722190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143be2c-a6ef-42eb-a9ba-e9a38ff676c0 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:20.747441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080943-1066-4c24-88be-7be81109a600 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:20.755364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:20.756006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.756278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.756539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.766894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:20.771990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:20.772834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:20.773726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 71/148] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:20.778690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:20.801174 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:20.812781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:20.854066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080943-1066-4c24-88be-7be81109a600 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:20.882347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc78ce-7e0a-4e90-acc9-0c79a68cc781 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:20.888608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:20.889241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.889512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.889777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.900431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:20.905249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:20.906170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:20.906951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 78/149] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:14:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:20.907582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:20.919632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:20.920244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:20.920519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:20.920788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:20.921453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:20.921750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:20.923142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:20.931127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 72/150] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:20.936063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.004802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48a54d-02fc-4bd8-9a32-30d39b85a256 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.013723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:21.028663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:21.037721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308db8ce-129b-4cd0-b694-5b5c4c91310c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.038893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.039525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.039810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.040084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.041207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.042675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.044426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 79/151] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:21.045109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.072912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.073528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.073802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.074074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.074738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:21.075066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.076464 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.085494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 73/152] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:21.085494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.145218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c478ca4-cb56-4658-a580-0f6a91d699e5 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.177984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.178612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.178933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.179204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] PATH_INFO: `/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.187518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113e98-598c-4e77-8d3e-ea608c9d7e5e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.192462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] RBAC: Authorizing `identity:get_user(user_id=10380b7f8bc8478bb7ef2f1cc0b5f547)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.193947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.195708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 80/153] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:21 2022] GET /identity/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:21.199626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.222879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.223485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.223758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.224024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.224669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.226097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.236070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:21.247265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 74/154] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:21 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:21.248073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.273898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:21.312870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed903e54-39d5-4616-9cb7-664a0d84d774 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.359131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.359783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.360067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.360339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] PATH_INFO: `/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.361508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] RBAC: Authorizing `identity:get_user(user_id=10380b7f8bc8478bb7ef2f1cc0b5f547)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.363009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.364656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 81/155] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:21 2022] GET /identity/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:21.370417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.388778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e6931-89a2-4743-907c-1de27e17c41f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.428909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.429477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.429751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.430019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.431578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.433109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.434910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 75/156] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:21 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:21.440577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.482124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929e355-0257-411a-ae63-654a30249d18 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.483713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:21.526718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.528175 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.528175 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.528175 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.529322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.530777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.532511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 82/157] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:21 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:21.538241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:21.539543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:21.566601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234cd4c-60ba-48cf-9621-e8d41bf89912 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.610320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb52ed-f659-46fc-8490-b17c46f099e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.611029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb52ed-f659-46fc-8490-b17c46f099e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.611302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb52ed-f659-46fc-8490-b17c46f099e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.612219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb52ed-f659-46fc-8490-b17c46f099e4 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312/users/10380b7f8bc8478bb7ef2f1cc0b5f547/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.613872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb52ed-f659-46fc-8490-b17c46f099e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a210a78f477c407ba096da5266c3c312, user_id=10380b7f8bc8478bb7ef2f1cc0b5f547, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.615186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb52ed-f659-46fc-8490-b17c46f099e4 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.632165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 76/158] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:21 2022] PUT /identity/v3/projects/a210a78f477c407ba096da5266c3c312/users/10380b7f8bc8478bb7ef2f1cc0b5f547/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:14:21.665719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a4d2f-7d04-407e-9b94-e93ff1edd182 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:21.704625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45fc08-4806-4600-8eb7-64ee48896cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:21.705314 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fc08-4806-4600-8eb7-64ee48896cf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:21.705589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fc08-4806-4600-8eb7-64ee48896cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:21.705858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fc08-4806-4600-8eb7-64ee48896cf5 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312/users/10380b7f8bc8478bb7ef2f1cc0b5f547/roles/60a9b9055fe947f6adfcc4173f804a58` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:21.708257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45fc08-4806-4600-8eb7-64ee48896cf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a210a78f477c407ba096da5266c3c312, user_id=10380b7f8bc8478bb7ef2f1cc0b5f547, role_id=60a9b9055fe947f6adfcc4173f804a58)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:21.709846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45fc08-4806-4600-8eb7-64ee48896cf5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:21.726801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 83/159] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:21 2022] PUT /identity/v3/projects/a210a78f477c407ba096da5266c3c312/users/10380b7f8bc8478bb7ef2f1cc0b5f547/roles/60a9b9055fe947f6adfcc4173f804a58 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:14:23.537681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bc4d3-b11b-4986-924f-80b199f33bdc None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.538217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bc4d3-b11b-4986-924f-80b199f33bdc None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.538217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bc4d3-b11b-4986-924f-80b199f33bdc None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.539978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 77/160] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:23.545589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384d88-2c93-4d74-bce3-fc95376ec786 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.545996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384d88-2c93-4d74-bce3-fc95376ec786 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.546190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384d88-2c93-4d74-bce3-fc95376ec786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.565294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d0384d88-2c93-4d74-bce3-fc95376ec786 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:23.566482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d0384d88-2c93-4d74-bce3-fc95376ec786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:23.592267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:23.606573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6485b1-dfd9-4b36-8752-06dae44c9054 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.607170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6485b1-dfd9-4b36-8752-06dae44c9054 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.607657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6485b1-dfd9-4b36-8752-06dae44c9054 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.609187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 78/161] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:23.614481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c7b7-7c54-48ec-8f84-5a33d0975400 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.615066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c7b7-7c54-48ec-8f84-5a33d0975400 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.615602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c7b7-7c54-48ec-8f84-5a33d0975400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.635183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9288c7b7-7c54-48ec-8f84-5a33d0975400 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:23.636659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9288c7b7-7c54-48ec-8f84-5a33d0975400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:23.646916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 84/162] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:23.705551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 79/163] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:23.832038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95403e5-9ed6-4db5-96e3-5f00fd0f3084 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.832357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95403e5-9ed6-4db5-96e3-5f00fd0f3084 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.832595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95403e5-9ed6-4db5-96e3-5f00fd0f3084 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.833978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 85/164] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:23.840052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7fc13-f873-48d9-84a4-7d5450153c6d None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.840582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7fc13-f873-48d9-84a4-7d5450153c6d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.841068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7fc13-f873-48d9-84a4-7d5450153c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.860167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-41d7fc13-f873-48d9-84a4-7d5450153c6d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:23.861923 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-41d7fc13-f873-48d9-84a4-7d5450153c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:23.863250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d603-10f7-4299-af1e-2b52c6579c32 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.863538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d603-10f7-4299-af1e-2b52c6579c32 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.863811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d603-10f7-4299-af1e-2b52c6579c32 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.865161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 86/165] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:23.871235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69982981-ce37-48bb-8e7a-fb5c06ebfb63 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:23.871517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69982981-ce37-48bb-8e7a-fb5c06ebfb63 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:23.871790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69982981-ce37-48bb-8e7a-fb5c06ebfb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:23.891581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-69982981-ce37-48bb-8e7a-fb5c06ebfb63 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:23.892979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-69982981-ce37-48bb-8e7a-fb5c06ebfb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:23.926128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:23.932854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 80/166] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:23.933929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7fc13-f873-48d9-84a4-7d5450153c6d None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:23.982392 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 87/167] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:23.983867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69982981-ce37-48bb-8e7a-fb5c06ebfb63 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.040214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7fc13-f873-48d9-84a4-7d5450153c6d None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.074196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.075104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.075481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.075960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.081452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.088535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:24.092110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69982981-ce37-48bb-8e7a-fb5c06ebfb63 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:24.094006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:24.095191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:24.096184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:24.097833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 81/168] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:24.104189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.133851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.134690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.135386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.135881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.137232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:24.139260 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:24.141543 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 88/169] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:24.146838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.183195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.226979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de8b9c-5482-400c-ae2a-08c570ec2b4f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.265900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.266518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.266795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.267093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.267762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] RBAC: Adding query filter params (name=member) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:24.268062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:24.269489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:24.271888 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c1ef-6a2c-4061-9ef1-96372f8ca10f None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.277959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 82/170] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:24.278757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.306390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.307027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.307359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.307628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.308270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:24.309707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:24.333833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 89/171] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:24 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:24.333833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.357509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.397921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9a9d-7fbc-4413-836b-d4cce0bdba54 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.420697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.439374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.440017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.440507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.440778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.452977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:24.453630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea67cf-2696-4751-a695-397ce4f278b5 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:24.459617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:24.460585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 83/172] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:24.467134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.491491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.492445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.492725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.493035 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.504574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:24.509973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:24.510897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:24.511693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:24.516024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 90/173] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:24.517234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.588285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20df59-99ba-4555-acab-122d304b01ca None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.604651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.630744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.631426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.631703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.631974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] PATH_INFO: `/v3/users/25c9fd5a9afc4424b74c3fa05b5154e7` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.638531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a357-a24d-4d08-a170-a5416128de55 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.647391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] RBAC: Authorizing `identity:get_user(user_id=25c9fd5a9afc4424b74c3fa05b5154e7)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:24.648925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:24.650799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 84/174] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/users/25c9fd5a9afc4424b74c3fa05b5154e7 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:24.651592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.676521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.677133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.677409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.677674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.678338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:24.678636 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:24.680060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:24.692616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 91/175] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:24.692816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.706048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.789593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb82744-67db-4604-be49-89f82c4b84f6 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.810319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63557ce1-a7e0-4bde-a2a7-9af2705d6cfe None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.835243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.836089 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.836371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.836729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.838011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:24.838320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:24.840357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:24.844975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:24.845708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:24.846053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:24.846414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:24.847672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:24.849258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:24.849739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 85/176] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:24.850569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.851254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 92/177] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:24.860813 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:24.864825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.968600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76be03e-f263-44d2-99f3-960ca709c251 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:24.976448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:24.980071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c194485-674d-4e53-8f56-f388a11d0bff None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:25.008868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.009855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.010207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.010577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312/users/25c9fd5a9afc4424b74c3fa05b5154e7/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.012758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] RBAC: Authorizing `identity:create_grant(project_id=a210a78f477c407ba096da5266c3c312, user_id=25c9fd5a9afc4424b74c3fa05b5154e7, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.014444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.018074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.018960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.019185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.019537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] PATH_INFO: `/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.020797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] RBAC: Authorizing `identity:get_user(user_id=10380b7f8bc8478bb7ef2f1cc0b5f547)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.022660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.024527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 86/178] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:24 2022] GET /identity/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:25.027039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:25.034642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 93/179] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:24 2022] PUT /identity/v3/projects/a210a78f477c407ba096da5266c3c312/users/25c9fd5a9afc4424b74c3fa05b5154e7/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:14:25.039890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:25.136082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439b58-21c8-4b8b-a545-275f0e9c7846 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:25.173947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.174892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.175319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.175741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] PATH_INFO: `/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.177155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] RBAC: Authorizing `identity:get_user(user_id=10380b7f8bc8478bb7ef2f1cc0b5f547)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.178753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.180891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 87/180] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:25 2022] GET /identity/v3/users/10380b7f8bc8478bb7ef2f1cc0b5f547 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:25.188272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:25.191753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:25.251943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e80da-ce79-483e-b43c-200cd993484b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:25.271207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:25.319942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.321542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.321817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.322084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.376583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dba50-7b18-4831-a35a-42aba8addea6 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:25.410204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.412471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.414960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.415686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.416060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.416424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.483189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:25.505152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.507651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.525404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 94/181] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:25.530913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:25.550204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:25.630367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151373b-c00c-4394-b355-3421c6341f6a None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:25.634331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 88/182] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 13:14:25.644973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:25.685330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.686117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.686491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.686944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.694839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.694839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.703214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 95/183] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:25 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:25.708970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:25.764479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:25.821858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21831-5113-4884-86df-22137acc2163 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:25.885212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.885861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.886135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.886405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.887700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.889153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.890807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 89/184] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:25 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:25.894612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff358101-bcff-46ee-82db-2700c1623d53 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:25.896984 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:25.905815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:25.953099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca6f01-01a3-406b-83cc-09a8c52652dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:25.953714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca6f01-01a3-406b-83cc-09a8c52652dd None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:25.953988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca6f01-01a3-406b-83cc-09a8c52652dd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:25.954304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca6f01-01a3-406b-83cc-09a8c52652dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:25.955066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca6f01-01a3-406b-83cc-09a8c52652dd None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=a210a78f477c407ba096da5266c3c312, user.id=10380b7f8bc8478bb7ef2f1cc0b5f547) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:25.955375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca6f01-01a3-406b-83cc-09a8c52652dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:25.957438 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca6f01-01a3-406b-83cc-09a8c52652dd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:25.964953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 96/185] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:25 2022] GET /identity/v3/role_assignments?user.id=10380b7f8bc8478bb7ef2f1cc0b5f547&scope.project.id=a210a78f477c407ba096da5266c3c312&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:26.091670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1cb10-b27a-4d88-84c6-615787113c47 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:26.149601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aad5c-93bf-4014-ba35-c5ae6d0d915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:26.150243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aad5c-93bf-4014-ba35-c5ae6d0d915c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:26.150522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aad5c-93bf-4014-ba35-c5ae6d0d915c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:26.150791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aad5c-93bf-4014-ba35-c5ae6d0d915c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:26.151559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aad5c-93bf-4014-ba35-c5ae6d0d915c None admin] RBAC: Adding query filter params (role.id=60a9b9055fe947f6adfcc4173f804a58, scope.project.id=a210a78f477c407ba096da5266c3c312, user.id=10380b7f8bc8478bb7ef2f1cc0b5f547) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:26.151860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aad5c-93bf-4014-ba35-c5ae6d0d915c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:26.153324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aad5c-93bf-4014-ba35-c5ae6d0d915c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:26.165488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 90/186] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:25 2022] GET /identity/v3/role_assignments?user.id=10380b7f8bc8478bb7ef2f1cc0b5f547&scope.project.id=a210a78f477c407ba096da5266c3c312&role.id=60a9b9055fe947f6adfcc4173f804a58 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:26.797649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3aecb-bc0a-4e86-ab4e-b886ccef83b2 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:26.798180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3aecb-bc0a-4e86-ab4e-b886ccef83b2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:26.798180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3aecb-bc0a-4e86-ab4e-b886ccef83b2 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:26.799546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 97/187] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:26.805025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e576-62a4-407f-840c-8111056d9a8e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:26.805514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e576-62a4-407f-840c-8111056d9a8e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:26.805590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e576-62a4-407f-840c-8111056d9a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:26.824239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-c795e576-62a4-407f-840c-8111056d9a8e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:26.825424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c795e576-62a4-407f-840c-8111056d9a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:26.849281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df3e97-052d-44d5-964e-a4fe535942ac None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:26.849576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df3e97-052d-44d5-964e-a4fe535942ac None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:26.849828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df3e97-052d-44d5-964e-a4fe535942ac None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:26.851397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 98/188] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:26.856287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6028ad7-2717-4e19-a63a-eaad8f75a0c9 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:26.856569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6028ad7-2717-4e19-a63a-eaad8f75a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:26.856820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6028ad7-2717-4e19-a63a-eaad8f75a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:26.874750 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d6028ad7-2717-4e19-a63a-eaad8f75a0c9 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:26.875955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d6028ad7-2717-4e19-a63a-eaad8f75a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:26.891350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:26.898031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 91/189] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:26.945792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 99/190] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:27.158172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e576-62a4-407f-840c-8111056d9a8e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:27.210498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6028ad7-2717-4e19-a63a-eaad8f75a0c9 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:27.238956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:27.261397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e576-62a4-407f-840c-8111056d9a8e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:27.297714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:27.298351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.298623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.298908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.300012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:27.301445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:27.303213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 92/191] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:27.308500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:27.314559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6028ad7-2717-4e19-a63a-eaad8f75a0c9 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:27.352576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:27.353214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.353489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.353755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.363903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:27.368858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:27.369695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:27.370442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 100/192] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:27.375759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:27.385005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:27.422775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a09a78-ca88-49fc-90d6-ca3839d7168a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:27.459406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:27.460042 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.460319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.460606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.461264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:27.463024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:27.467786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:27.486112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 93/193] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:27 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:14:27.487558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816e2df-2837-4cc6-917d-8aa0e810c089 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:27.528397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8761a0-3d1f-4689-b2c5-246d091c38e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:27.529359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8761a0-3d1f-4689-b2c5-246d091c38e1 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.529820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8761a0-3d1f-4689-b2c5-246d091c38e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.530250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8761a0-3d1f-4689-b2c5-246d091c38e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.531122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8761a0-3d1f-4689-b2c5-246d091c38e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:27.531602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8761a0-3d1f-4689-b2c5-246d091c38e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:27.533251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8761a0-3d1f-4689-b2c5-246d091c38e1 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:27.544643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 101/194] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:27.550350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:27.569141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046013d-fec7-489b-8dc9-b77e2dbc9315 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.569429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046013d-fec7-489b-8dc9-b77e2dbc9315 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.569721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046013d-fec7-489b-8dc9-b77e2dbc9315 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.571392 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 102/195] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:14:27.577043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e9c6-5579-40e9-8d3c-c95a5251dc50 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.577319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e9c6-5579-40e9-8d3c-c95a5251dc50 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.577601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e9c6-5579-40e9-8d3c-c95a5251dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.596831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d4b4e9c6-5579-40e9-8d3c-c95a5251dc50 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:27.598109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d4b4e9c6-5579-40e9-8d3c-c95a5251dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:27.672488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4e9d7-84a4-410d-8edd-4bd619613907 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:27.676944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 103/196] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:27.698606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:27.718061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:27.718704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.719049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.719318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] PATH_INFO: `/v3/users/9e150d5cc5034209ad3553c6bdf98881` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.734250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] RBAC: Authorizing `identity:get_user(user_id=9e150d5cc5034209ad3553c6bdf98881)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:27.735815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:27.737501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 94/197] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:27 2022] GET /identity/v3/users/9e150d5cc5034209ad3553c6bdf98881 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:27.743289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e9c6-5579-40e9-8d3c-c95a5251dc50 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:27.826754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:27.851245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e9c6-5579-40e9-8d3c-c95a5251dc50 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:27.886342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:27.887032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:27.887310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:27.887574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:27.888701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:27.890245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:27.892095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 104/198] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:27 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:27.897786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:27.943941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:28.024170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d036c-40af-47b0-9b25-a45086498c2c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:28.060529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a39560-0823-4b1b-b9b6-340c3d25dd88 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:28.074943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:28.076086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:28.076362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:28.076892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312/users/9e150d5cc5034209ad3553c6bdf98881/roles/2ce82b71b3ac44ceb433aaa512819a74` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:28.079469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] RBAC: Authorizing `identity:create_grant(project_id=a210a78f477c407ba096da5266c3c312, user_id=9e150d5cc5034209ad3553c6bdf98881, role_id=2ce82b71b3ac44ceb433aaa512819a74)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:28.080920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:28.098062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:28.098596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 95/199] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:27 2022] PUT /identity/v3/projects/a210a78f477c407ba096da5266c3c312/users/9e150d5cc5034209ad3553c6bdf98881/roles/2ce82b71b3ac44ceb433aaa512819a74 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:28.098876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:28.099307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:28.099634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:28.118912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:28.125835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:28.126776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:28.127578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 105/200] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:28.133476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:28.183261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:28.244040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e3f4-b49d-43d9-838f-3e8d791f7388 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:28.285117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:28.285749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:28.286024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:28.286292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:28.287001 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:28.287305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:28.289013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:28.298328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 96/201] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:28.303978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:28.317264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:28.409692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dbfea-026a-4578-b541-7b1b1f84ca77 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:28.444595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:28.445245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:28.445512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:28.445778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] PATH_INFO: `/v3/users/25c9fd5a9afc4424b74c3fa05b5154e7` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:28.446979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] RBAC: Authorizing `identity:get_user(user_id=25c9fd5a9afc4424b74c3fa05b5154e7)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:28.448439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:28.450386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 106/202] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:28 2022] GET /identity/v3/users/25c9fd5a9afc4424b74c3fa05b5154e7 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:28.455997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:28.556006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed8e85-6c2a-42f2-bcab-5f5ece80de1f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:28.558342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:28.594764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:28.595403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:28.595679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:28.595948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:28.661418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:28.662887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:28.761655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 97/203] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:28.767644 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:28.846638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:28.871940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1234bb-741f-4349-b798-b0f226669500 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:28.905853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02276d9-0fc7-471c-ad14-bef0c76d8688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:28.906479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02276d9-0fc7-471c-ad14-bef0c76d8688 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:28.906758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02276d9-0fc7-471c-ad14-bef0c76d8688 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:28.907061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02276d9-0fc7-471c-ad14-bef0c76d8688 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:28.908188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02276d9-0fc7-471c-ad14-bef0c76d8688 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:28.909654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02276d9-0fc7-471c-ad14-bef0c76d8688 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:28.911493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 107/204] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:28 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:28.917853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:28.920256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:29.019788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ffd8-30f6-4b4b-a83c-cb4ce10510d3 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:29.053871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229899a-0405-47e3-83c9-d81830c1771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:29.054481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229899a-0405-47e3-83c9-d81830c1771e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:29.054758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229899a-0405-47e3-83c9-d81830c1771e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:29.055053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229899a-0405-47e3-83c9-d81830c1771e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:29.055865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229899a-0405-47e3-83c9-d81830c1771e None admin] RBAC: Adding query filter params (role.id=80afb3528aef4ca38d372f9e8ea1c662, scope.project.id=a210a78f477c407ba096da5266c3c312, user.id=25c9fd5a9afc4424b74c3fa05b5154e7) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:29.056168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229899a-0405-47e3-83c9-d81830c1771e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:29.057610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229899a-0405-47e3-83c9-d81830c1771e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:29.063451 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 98/205] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:28 2022] GET /identity/v3/role_assignments?user.id=25c9fd5a9afc4424b74c3fa05b5154e7&scope.project.id=a210a78f477c407ba096da5266c3c312&role.id=80afb3528aef4ca38d372f9e8ea1c662 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:29.835516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ed9e-82fe-4bb5-be33-615fd39495ce None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:29.835896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ed9e-82fe-4bb5-be33-615fd39495ce None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:29.835998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a0b38-2e79-4ba8-8283-9d9ecac24392 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:29.836098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ed9e-82fe-4bb5-be33-615fd39495ce None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:29.836289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a0b38-2e79-4ba8-8283-9d9ecac24392 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:29.836688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a0b38-2e79-4ba8-8283-9d9ecac24392 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:29.837582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 108/206] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:29.838285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 99/207] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:14:29.842898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77104a-f6b5-4a1e-939f-eded78139b66 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:29.843145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703df7b-0e94-4b48-8865-e9cceb18b92c None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:29.843244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77104a-f6b5-4a1e-939f-eded78139b66 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:29.843431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703df7b-0e94-4b48-8865-e9cceb18b92c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:29.843523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77104a-f6b5-4a1e-939f-eded78139b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:29.843698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703df7b-0e94-4b48-8865-e9cceb18b92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:29.861360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6f77104a-f6b5-4a1e-939f-eded78139b66 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:29.862532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6f77104a-f6b5-4a1e-939f-eded78139b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:29.863800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3703df7b-0e94-4b48-8865-e9cceb18b92c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:29.865174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3703df7b-0e94-4b48-8865-e9cceb18b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:29.934454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:29.935344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 109/208] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:29.945327 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 100/209] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:30.201026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77104a-f6b5-4a1e-939f-eded78139b66 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:30.204980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703df7b-0e94-4b48-8865-e9cceb18b92c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:30.273681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:30.308750 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77104a-f6b5-4a1e-939f-eded78139b66 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:30.316963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703df7b-0e94-4b48-8865-e9cceb18b92c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:30.349262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:30.349979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.350397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.350632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.354433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:30.355105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.355370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.355640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.356714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:30.358190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:30.359949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 101/210] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:30.361243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:30.365189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:30.366093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:30.367022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:30.367953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 110/211] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:30.374341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:30.433414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:30.472214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224d73-f984-4649-81e1-cd20a4dfc887 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:30.472383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f697f8d-8d4f-4683-b3a2-d6b235b17280 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:30.502062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:30.507357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ec51a-d283-4290-acac-eaf104ff00a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:30.507491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec7c4c-3f34-43d9-9275-f8a4760a77da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:30.508019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ec51a-d283-4290-acac-eaf104ff00a7 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.508147 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec7c4c-3f34-43d9-9275-f8a4760a77da None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.508308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ec51a-d283-4290-acac-eaf104ff00a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.508410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec7c4c-3f34-43d9-9275-f8a4760a77da None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.508647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ec51a-d283-4290-acac-eaf104ff00a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.508788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec7c4c-3f34-43d9-9275-f8a4760a77da None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.509264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ec51a-d283-4290-acac-eaf104ff00a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:30.509392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec7c4c-3f34-43d9-9275-f8a4760a77da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:30.509559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ec51a-d283-4290-acac-eaf104ff00a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:30.510849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec7c4c-3f34-43d9-9275-f8a4760a77da None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:30.510994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ec51a-d283-4290-acac-eaf104ff00a7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:30.519203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 111/212] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:30.521541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3cd70-5332-4299-884c-cbbba7b12131 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.521878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3cd70-5332-4299-884c-cbbba7b12131 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.522253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3cd70-5332-4299-884c-cbbba7b12131 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.523651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 112/213] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:30.524948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3cd70-5332-4299-884c-cbbba7b12131 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:30.532866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 102/214] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:30 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:14:30.534041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d49850-8dbf-4b7c-8431-8f431e21419d None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.534320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d49850-8dbf-4b7c-8431-8f431e21419d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.534589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d49850-8dbf-4b7c-8431-8f431e21419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.553696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f7d49850-8dbf-4b7c-8431-8f431e21419d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:30.554950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f7d49850-8dbf-4b7c-8431-8f431e21419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:30.625900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 103/215] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:30.657347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3cd70-5332-4299-884c-cbbba7b12131 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:30.695345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:30.696461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.697029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.697474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] PATH_INFO: `/v3/users/075494f82b304004a455d3cb884d2d9e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.712777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] RBAC: Authorizing `identity:get_user(user_id=075494f82b304004a455d3cb884d2d9e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:30.714501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:30.716363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 113/216] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:30 2022] GET /identity/v3/users/075494f82b304004a455d3cb884d2d9e => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:30.722326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d49850-8dbf-4b7c-8431-8f431e21419d None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:30.773534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:30.826150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d49850-8dbf-4b7c-8431-8f431e21419d None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:30.863361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:30.864031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:30.864310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:30.864578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:30.865301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] RBAC: Adding query filter params (role.id=80afb3528aef4ca38d372f9e8ea1c662, user.id=075494f82b304004a455d3cb884d2d9e, scope.system=all) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:30.865601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:30.867090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:30.872865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 104/217] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Oct 11 13:14:30 2022] GET /identity/v3/role_assignments?user.id=075494f82b304004a455d3cb884d2d9e&scope.system=all&role.id=80afb3528aef4ca38d372f9e8ea1c662 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:30.887803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:30.952104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:31.012505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661221-cd62-499c-a6a2-8979cd869422 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:31.050921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:31.051571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:31.051842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:31.052104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:31.064587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:31.069555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:31.070410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:31.071415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 114/218] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:31.076693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:31.182807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48acd-7184-4f80-8754-02c3ae16f8a5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:31.198152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:31.220625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:31.221242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:31.221515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:31.221782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:31.222448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:31.222743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:31.224145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:31.233184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 105/219] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:31.239036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:31.345444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e9b1-4a18-4f14-bbac-dd02b0843082 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:31.360204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:31.385736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:31.386730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:31.387238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:31.387732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] PATH_INFO: `/v3/users/9e150d5cc5034209ad3553c6bdf98881` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:31.389171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] RBAC: Authorizing `identity:get_user(user_id=9e150d5cc5034209ad3553c6bdf98881)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:31.390902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:31.392727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 115/220] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:31 2022] GET /identity/v3/users/9e150d5cc5034209ad3553c6bdf98881 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:31.402855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:31.502280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a103a-af12-4fe4-9375-e0f9c075fb12 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:31.536952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:31.537564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:31.537837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:31.538101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:31.587103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:31.611602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:31.613093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:31.717589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 106/221] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:31.718964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:31.827138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b520-2724-4858-a7e3-5387718f3354 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:31.861175 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b902a4-1a0b-4fe3-9469-6d7c566a9721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:31.861730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b902a4-1a0b-4fe3-9469-6d7c566a9721 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:31.862049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b902a4-1a0b-4fe3-9469-6d7c566a9721 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:31.862318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b902a4-1a0b-4fe3-9469-6d7c566a9721 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:31.863460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b902a4-1a0b-4fe3-9469-6d7c566a9721 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:31.864918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b902a4-1a0b-4fe3-9469-6d7c566a9721 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:31.866546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 116/222] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:31 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:31.872510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:31.947639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:31.972032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6bd1-e7e9-458f-a1ca-49a23b64c7d2 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:32.009740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dcb95-221d-421f-a1ed-b907a855b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:32.010347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcb95-221d-421f-a1ed-b907a855b223 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:32.010618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcb95-221d-421f-a1ed-b907a855b223 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:32.010916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcb95-221d-421f-a1ed-b907a855b223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:32.011640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dcb95-221d-421f-a1ed-b907a855b223 None admin] RBAC: Adding query filter params (role.id=2ce82b71b3ac44ceb433aaa512819a74, scope.project.id=a210a78f477c407ba096da5266c3c312, user.id=9e150d5cc5034209ad3553c6bdf98881) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:32.011942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dcb95-221d-421f-a1ed-b907a855b223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:32.013368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dcb95-221d-421f-a1ed-b907a855b223 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:32.019336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 107/223] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:14:31 2022] GET /identity/v3/role_assignments?user.id=9e150d5cc5034209ad3553c6bdf98881&scope.project.id=a210a78f477c407ba096da5266c3c312&role.id=2ce82b71b3ac44ceb433aaa512819a74 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:32.893540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75b20-a57b-4623-92e8-34932a55e684 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:32.894121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75b20-a57b-4623-92e8-34932a55e684 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:32.894121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75b20-a57b-4623-92e8-34932a55e684 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:32.895430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 117/224] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:32.900915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726940b-079d-4379-b8c0-ff0d1165d22a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:32.901315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726940b-079d-4379-b8c0-ff0d1165d22a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:32.901443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726940b-079d-4379-b8c0-ff0d1165d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:32.914680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d22b-887d-4744-8eb3-4d75775f1b37 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:32.915033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d22b-887d-4744-8eb3-4d75775f1b37 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:32.915374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d22b-887d-4744-8eb3-4d75775f1b37 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:32.916693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 118/225] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:14:32.921238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5726940b-079d-4379-b8c0-ff0d1165d22a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:32.921771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90dce-5d3a-4111-8c09-0d262739572d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:32.922050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90dce-5d3a-4111-8c09-0d262739572d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:32.922317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90dce-5d3a-4111-8c09-0d262739572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:32.922405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5726940b-079d-4379-b8c0-ff0d1165d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:32.941746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-eda90dce-5d3a-4111-8c09-0d262739572d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:32.943045 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-eda90dce-5d3a-4111-8c09-0d262739572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:32.992176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:33.001401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 108/226] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:33.016250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 119/227] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:33.063854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dba42-bd87-4aad-9c6c-dc2174e93215 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.064199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dba42-bd87-4aad-9c6c-dc2174e93215 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.064386 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dba42-bd87-4aad-9c6c-dc2174e93215 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.065949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 109/228] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:33.071018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843acd34-1712-43ef-9d0a-2b19bcf2dc0d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.071307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843acd34-1712-43ef-9d0a-2b19bcf2dc0d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.071542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843acd34-1712-43ef-9d0a-2b19bcf2dc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.090221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-843acd34-1712-43ef-9d0a-2b19bcf2dc0d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:33.091401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-843acd34-1712-43ef-9d0a-2b19bcf2dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:33.160877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 120/229] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:33.264593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dba42-bd87-4aad-9c6c-dc2174e93215 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.274496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843acd34-1712-43ef-9d0a-2b19bcf2dc0d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.348655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:33.380151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843acd34-1712-43ef-9d0a-2b19bcf2dc0d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.381963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dba42-bd87-4aad-9c6c-dc2174e93215 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.390122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:33.415934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.416487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.416758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.417024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.417826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.418096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:33.418501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.418776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.419068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.419564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:33.421312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 121/230] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:33.426469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.433971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:33.438894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:33.439770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:33.440557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 110/231] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:33.441205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.525100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd1395-ec61-4bab-943d-b2486f5f967d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.537547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4394-7b65-4cbf-b2ec-cfd4df25bb5e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.559876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.560475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.560741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.561029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] PATH_INFO: `/v3/groups` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.561649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:33.563122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:33.566676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:33.573620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.574252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.574529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.574797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.578776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 122/232] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Oct 11 13:14:33 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:14:33.578776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.590368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:33.595517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:33.596511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:33.597287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:33.602249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 111/233] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:33.603496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.630041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:33.715039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97842a3b-cac5-47b9-a6e4-bc34d80a6836 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.720119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7b3c-6cdb-4b6c-a2cc-fb281b881a36 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.754318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.754973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.755256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.755530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.756204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:33.756507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:33.757905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:33.759582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.760197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.760471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.760735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.761405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] RBAC: Adding query filter params (name=member) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:33.761703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:33.763092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:33.769152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 123/234] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:33.771689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 112/235] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:33.775845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.778548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.833409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:33.878325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:33.882681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca19cb1-cc60-4357-ba25-6af3e4ea3170 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.887297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29a70d-d1b2-4652-8f0f-5ec0495cd96c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:33.918212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.918947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.919114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.919381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] PATH_INFO: `/v3/users/765bfaf979c343b992939f2836447da4` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.922061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:33.922690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:33.922989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:33.923256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] PATH_INFO: `/v3/users/075494f82b304004a455d3cb884d2d9e` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:33.924373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] RBAC: Authorizing `identity:get_user(user_id=075494f82b304004a455d3cb884d2d9e)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:33.925800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:33.927435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 113/236] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/users/075494f82b304004a455d3cb884d2d9e => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:33.932949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:33.933913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] RBAC: Authorizing `identity:get_user(user_id=765bfaf979c343b992939f2836447da4)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:33.935434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:33.937272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 124/237] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/users/765bfaf979c343b992939f2836447da4 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:33.942794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:34.039127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1640e0-467c-4f53-9b28-02c8a5bc023b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:34.045359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96127470-1139-4631-962b-5055c3a1c1d8 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:34.059547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:34.074524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4b768-ce52-4f15-92e1-91ac7ccbc87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:34.075219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b768-ce52-4f15-92e1-91ac7ccbc87c None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:34.075495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b768-ce52-4f15-92e1-91ac7ccbc87c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:34.075909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b768-ce52-4f15-92e1-91ac7ccbc87c None admin] PATH_INFO: `/v3/system/users/075494f82b304004a455d3cb884d2d9e/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:34.077168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4b768-ce52-4f15-92e1-91ac7ccbc87c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=075494f82b304004a455d3cb884d2d9e, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:34.078772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4b768-ce52-4f15-92e1-91ac7ccbc87c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:34.080921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e7837-df99-401b-ab18-f5b05d8189a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:34.081580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e7837-df99-401b-ab18-f5b05d8189a5 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:34.081857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e7837-df99-401b-ab18-f5b05d8189a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:34.082579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e7837-df99-401b-ab18-f5b05d8189a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:34.083282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e7837-df99-401b-ab18-f5b05d8189a5 None admin] RBAC: Adding query filter params (role.id=2ce82b71b3ac44ceb433aaa512819a74, user.id=765bfaf979c343b992939f2836447da4, scope.system=all) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:34.083647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e7837-df99-401b-ab18-f5b05d8189a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:34.085242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e7837-df99-401b-ab18-f5b05d8189a5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:34.089866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 114/238] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Oct 11 13:14:33 2022] PUT /identity/v3/system/users/075494f82b304004a455d3cb884d2d9e/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:14:34.091898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 125/239] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Oct 11 13:14:33 2022] GET /identity/v3/role_assignments?user.id=765bfaf979c343b992939f2836447da4&scope.system=all&role.id=2ce82b71b3ac44ceb433aaa512819a74 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:35.752010 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33b47d-ef49-4c90-8dd0-dc7c38ede6e1 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:35.752541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33b47d-ef49-4c90-8dd0-dc7c38ede6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:35.752541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33b47d-ef49-4c90-8dd0-dc7c38ede6e1 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:35.754050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 115/240] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:35.759403 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64555b-c838-4907-ac05-86410030797c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:35.759826 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64555b-c838-4907-ac05-86410030797c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:35.759897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64555b-c838-4907-ac05-86410030797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:35.778471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-fe64555b-c838-4907-ac05-86410030797c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:35.779692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fe64555b-c838-4907-ac05-86410030797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:35.795324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:35.849745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 126/241] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:36.114501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33b47d-ef49-4c90-8dd0-dc7c38ede6e1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:36.212534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dfc60-3f44-4c86-ba34-1289fd45e323 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.212818 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dfc60-3f44-4c86-ba34-1289fd45e323 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.213085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dfc60-3f44-4c86-ba34-1289fd45e323 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.214616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 127/242] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:14:36.215555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e89bd9-1aac-4ebc-9fe9-9300ae4342f5 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.215755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e89bd9-1aac-4ebc-9fe9-9300ae4342f5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.216042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e89bd9-1aac-4ebc-9fe9-9300ae4342f5 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.217318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 128/243] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:36.219336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc69f6-ccf9-4df9-b37b-4e3853e7c530 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.219664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc69f6-ccf9-4df9-b37b-4e3853e7c530 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.219946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc69f6-ccf9-4df9-b37b-4e3853e7c530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.227755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33b47d-ef49-4c90-8dd0-dc7c38ede6e1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:36.237917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5ecc69f6-ccf9-4df9-b37b-4e3853e7c530 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:36.239148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5ecc69f6-ccf9-4df9-b37b-4e3853e7c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:36.263418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3676b20-93ec-421c-9b95-bcc860541477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:36.264050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676b20-93ec-421c-9b95-bcc860541477 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.264383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676b20-93ec-421c-9b95-bcc860541477 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.264723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676b20-93ec-421c-9b95-bcc860541477 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.266008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3676b20-93ec-421c-9b95-bcc860541477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:36.267786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3676b20-93ec-421c-9b95-bcc860541477 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:36.269560 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 116/244] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:36.270635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f753d2d-200b-409e-a9a3-cd17d1c6de8d None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.270911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f753d2d-200b-409e-a9a3-cd17d1c6de8d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.271158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f753d2d-200b-409e-a9a3-cd17d1c6de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.289529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9f753d2d-200b-409e-a9a3-cd17d1c6de8d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:36.290881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9f753d2d-200b-409e-a9a3-cd17d1c6de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:36.308073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 129/245] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:36.308904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc69f6-ccf9-4df9-b37b-4e3853e7c530 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:36.340949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:36.362847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 117/246] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:36.402069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:36.422572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc69f6-ccf9-4df9-b37b-4e3853e7c530 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:36.457744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:36.458384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.458658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.458959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] PATH_INFO: `/v3/groups` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.459584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:36.461027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:36.477737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 130/247] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Oct 11 13:14:36 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:36.569667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f753d2d-200b-409e-a9a3-cd17d1c6de8d None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:36.626169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:36.686318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f753d2d-200b-409e-a9a3-cd17d1c6de8d None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:36.725578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:36.727083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.727083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.727083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.740710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:36.746466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:36.747409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:36.748175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:36.748761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c491ab-82b9-4014-ac04-67a2d5789b60 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:36.748845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 118/248] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:36.753441 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:36.786215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:36.786215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.786875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.786875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.798022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:36.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:36.808583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:36.809563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:36.810461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 131/249] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:36.813080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:36.815602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:36.880904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154bb51-2cbe-41ee-8c26-b40b448db2f3 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:36.921527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:36.922145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.922421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.922690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.923465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:36.923772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:36.925172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:36.931152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad31a5-8977-4717-84d8-c76a7aee5694 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:36.934510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 119/250] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:36.941289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:36.968046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:36.968799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:36.969147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:36.969527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:36.970266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] RBAC: Adding query filter params (name=member) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:36.970702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:36.972407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:36.986326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 132/251] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:36.991163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:37.064299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571faf8-46db-4339-a158-8eebd80afbc5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:37.071005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:37.074615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:37.111387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:37.112228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:37.112820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:37.113184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] PATH_INFO: `/v3/users/765bfaf979c343b992939f2836447da4` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:37.115170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] RBAC: Authorizing `identity:get_user(user_id=765bfaf979c343b992939f2836447da4)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:37.117443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:37.120663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 120/252] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:36 2022] GET /identity/v3/users/765bfaf979c343b992939f2836447da4 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:37.121167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f670341-b0c7-480d-9c8b-17e8ba810176 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:37.127644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:37.168990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:37.169816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:37.170097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:37.170370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] PATH_INFO: `/v3/users/075494f82b304004a455d3cb884d2d9e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:37.171545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] RBAC: Authorizing `identity:get_user(user_id=075494f82b304004a455d3cb884d2d9e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:37.172999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:37.174775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 133/253] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:36 2022] GET /identity/v3/users/075494f82b304004a455d3cb884d2d9e => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:37.182288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:37.282071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e272e8-6a66-40d8-a998-c24ee46b1092 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:37.309224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e66d57-9d11-4ccf-aad1-9c26bd302834 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:37.344674 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43098e-a9c6-45ec-82fa-16f9e92ca9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:37.345652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43098e-a9c6-45ec-82fa-16f9e92ca9b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:37.346100 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43098e-a9c6-45ec-82fa-16f9e92ca9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:37.346567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43098e-a9c6-45ec-82fa-16f9e92ca9b5 None admin] PATH_INFO: `/v3/system/users/765bfaf979c343b992939f2836447da4/roles/2ce82b71b3ac44ceb433aaa512819a74` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:37.348404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43098e-a9c6-45ec-82fa-16f9e92ca9b5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=765bfaf979c343b992939f2836447da4, role_id=2ce82b71b3ac44ceb433aaa512819a74)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:37.348916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:37.351155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43098e-a9c6-45ec-82fa-16f9e92ca9b5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:37.357538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192fe7-3eca-48b0-8b2f-58ff6a107906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:37.358133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192fe7-3eca-48b0-8b2f-58ff6a107906 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:37.358483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192fe7-3eca-48b0-8b2f-58ff6a107906 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:37.358748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192fe7-3eca-48b0-8b2f-58ff6a107906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:37.359663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192fe7-3eca-48b0-8b2f-58ff6a107906 None admin] RBAC: Adding query filter params (role.id=80afb3528aef4ca38d372f9e8ea1c662, user.id=075494f82b304004a455d3cb884d2d9e, scope.system=all) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:37.359972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192fe7-3eca-48b0-8b2f-58ff6a107906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:37.361481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 121/254] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Oct 11 13:14:37 2022] PUT /identity/v3/system/users/765bfaf979c343b992939f2836447da4/roles/2ce82b71b3ac44ceb433aaa512819a74 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:37.363899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192fe7-3eca-48b0-8b2f-58ff6a107906 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:37.381036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 134/255] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Oct 11 13:14:37 2022] GET /identity/v3/role_assignments?user.id=075494f82b304004a455d3cb884d2d9e&scope.system=all&role.id=80afb3528aef4ca38d372f9e8ea1c662 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:38.832369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616f04d-18c4-4094-8e1f-9aabff976938 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:38.832869 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616f04d-18c4-4094-8e1f-9aabff976938 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:38.833158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616f04d-18c4-4094-8e1f-9aabff976938 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:38.834746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 122/256] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:38.840134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2855305-432f-4ad6-9d4b-a9bc2623c681 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:38.840560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2855305-432f-4ad6-9d4b-a9bc2623c681 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:38.840734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2855305-432f-4ad6-9d4b-a9bc2623c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:38.864159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-b2855305-432f-4ad6-9d4b-a9bc2623c681 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:38.865370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b2855305-432f-4ad6-9d4b-a9bc2623c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:38.943775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 135/257] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 13:14:39.179873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b68fa-1097-4294-b5ce-7b3191f11f42 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.180268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b68fa-1097-4294-b5ce-7b3191f11f42 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.180615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b68fa-1097-4294-b5ce-7b3191f11f42 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.182583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 123/258] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:39.187495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea87f9-02ef-418b-85a5-06d17262ef28 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.187780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea87f9-02ef-418b-85a5-06d17262ef28 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.188051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea87f9-02ef-418b-85a5-06d17262ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.212191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ebea87f9-02ef-418b-85a5-06d17262ef28 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:39.213394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ebea87f9-02ef-418b-85a5-06d17262ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:39.221764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 136/259] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 13:14:39.489981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b68fa-1097-4294-b5ce-7b3191f11f42 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.503273 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b68fa-1097-4294-b5ce-7b3191f11f42 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.511798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.512446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.512721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.512989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.525137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:39.529995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:39.530838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:39.531626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:39.535064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 124/260] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:39.537535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea87f9-02ef-418b-85a5-06d17262ef28 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.548419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea87f9-02ef-418b-85a5-06d17262ef28 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.552956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.553567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.553849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.554117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.554785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] RBAC: Adding query filter params (name=member) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:39.556353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.558324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:14:39.558324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:14:39.558324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:14:39.559276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:39.568777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 137/261] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:39.576292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.586726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fb8e8-95bb-4b30-b435-7db6d1469fe5 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.593665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.594295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.594616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.594962 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.601667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.603840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:14:39.603840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:14:39.603840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:14:39.605058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:39.609465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 125/262] 10.222.0.16 () {56 vars in 1201 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:39.612881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.623644 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d5990-b949-44d2-a306-1acedfe0708c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.628174 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.628850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.629134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.629413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.630539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.632791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:39.638027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 138/263] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:39.640991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.651615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218f95-83f0-4414-8408-194d9d130623 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.657099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.657765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.658282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.658564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c/groups/23b752f74f4b4d1bae791b67e8376470/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.660565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc85f61719445e9848876aff636e33c, group_id=23b752f74f4b4d1bae791b67e8376470, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.661681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:14:39.661681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:14:39.661681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:14:39.664127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:39.692757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 126/264] 10.222.0.16 () {58 vars in 1463 bytes} [Tue Oct 11 13:14:39 2022] PUT /identity/v3/projects/6dc85f61719445e9848876aff636e33c/groups/23b752f74f4b4d1bae791b67e8376470/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:39.748484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.759163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac93ac9-ed30-45fa-baf1-c3345bba3e67 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.828774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.829442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.829754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.829996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.844018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:39.849158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:39.851695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:39.853682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 139/265] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:39.858854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.867497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfbec3-8941-45ba-83b2-a8b4ce2c9dc0 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.869742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:39.876376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.877348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.877949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.878115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.878906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:39.879919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.880815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:14:39.880815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:14:39.880815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:14:39.881948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:39.892296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 127/266] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:39.900026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.916701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad823a-7b35-4910-9315-ccc6cce7d475 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.926875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.927518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.927787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.928054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.931624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.932691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:14:39.932691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:14:39.932691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:14:39.933930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:39.935724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 140/267] 10.222.0.16 () {56 vars in 1201 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:39.941311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.952425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0f2f-7ec8-4da9-af52-39db8c6c7c2b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.961638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430f064-e61c-4283-9fc7-69851f63bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.962360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f064-e61c-4283-9fc7-69851f63bef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.962772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f064-e61c-4283-9fc7-69851f63bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.962960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f064-e61c-4283-9fc7-69851f63bef3 admin admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.964317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430f064-e61c-4283-9fc7-69851f63bef3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.966290 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430f064-e61c-4283-9fc7-69851f63bef3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:39.968388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 128/268] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Oct 11 13:14:39 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:39.973912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:39.988457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577b45-1f1c-4e95-8745-c8167e359f68 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:39.994095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd18a4-41e3-4a64-9e41-8057ec87c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:39.994803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd18a4-41e3-4a64-9e41-8057ec87c6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:39.995116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd18a4-41e3-4a64-9e41-8057ec87c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:39.995382 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd18a4-41e3-4a64-9e41-8057ec87c6fa admin admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c/groups/23b752f74f4b4d1bae791b67e8376470/roles/60a9b9055fe947f6adfcc4173f804a58` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:39.997618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd18a4-41e3-4a64-9e41-8057ec87c6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc85f61719445e9848876aff636e33c, group_id=23b752f74f4b4d1bae791b67e8376470, role_id=60a9b9055fe947f6adfcc4173f804a58)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:39.998802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-6bbd18a4-41e3-4a64-9e41-8057ec87c6fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:14:39.998802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:14:39.998802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:14:40.000781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd18a4-41e3-4a64-9e41-8057ec87c6fa admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:40.023485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 141/269] 10.222.0.16 () {58 vars in 1463 bytes} [Tue Oct 11 13:14:39 2022] PUT /identity/v3/projects/6dc85f61719445e9848876aff636e33c/groups/23b752f74f4b4d1bae791b67e8376470/roles/60a9b9055fe947f6adfcc4173f804a58 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:40.287662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64a926-2373-4425-b56c-7719cc104aeb None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.287662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64a926-2373-4425-b56c-7719cc104aeb None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.287662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64a926-2373-4425-b56c-7719cc104aeb None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.287662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 129/270] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:40.294483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aeca1-4bdc-4489-8d5b-700d4aceef63 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.294743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aeca1-4bdc-4489-8d5b-700d4aceef63 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.295049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aeca1-4bdc-4489-8d5b-700d4aceef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.317342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-437aeca1-4bdc-4489-8d5b-700d4aceef63 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:40.318896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-437aeca1-4bdc-4489-8d5b-700d4aceef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:40.375271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:40.396820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 142/271] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 13:14:40.777061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300aa7-94e2-402e-839b-6313a4948a79 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.777614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300aa7-94e2-402e-839b-6313a4948a79 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.778022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300aa7-94e2-402e-839b-6313a4948a79 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.779549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 130/272] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:40.785092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ea64-7188-42b5-a55d-82d5f84b8fc0 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.785525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ea64-7188-42b5-a55d-82d5f84b8fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.785948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ea64-7188-42b5-a55d-82d5f84b8fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.811451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-8d56ea64-7188-42b5-a55d-82d5f84b8fc0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:40.812851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8d56ea64-7188-42b5-a55d-82d5f84b8fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:40.827808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300aa7-94e2-402e-839b-6313a4948a79 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:40.849293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300aa7-94e2-402e-839b-6313a4948a79 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:40.861189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47903315-e749-4ba9-a9e9-8c8e74f51576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:40.862497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903315-e749-4ba9-a9e9-8c8e74f51576 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.863096 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903315-e749-4ba9-a9e9-8c8e74f51576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.863668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903315-e749-4ba9-a9e9-8c8e74f51576 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.887877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47903315-e749-4ba9-a9e9-8c8e74f51576 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-47903315-e749-4ba9-a9e9-8c8e74f51576 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:40.893265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:40.894328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:40.895188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 131/273] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Oct 11 13:14:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:40.895955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f70a-530b-4dba-8c51-2275f47caa06 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.896227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f70a-530b-4dba-8c51-2275f47caa06 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.896489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f70a-530b-4dba-8c51-2275f47caa06 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.900591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 132/274] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:40.902998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f70a-530b-4dba-8c51-2275f47caa06 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:40.919204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f70a-530b-4dba-8c51-2275f47caa06 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:40.928272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:40.928884 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.929155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.929420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.930164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:40.930460 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:40.932121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:40.937989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 143/275] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:40.939346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e29b-9c29-435e-9820-1918a06fbd31 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.939624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e29b-9c29-435e-9820-1918a06fbd31 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.939887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e29b-9c29-435e-9820-1918a06fbd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.953303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 133/276] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:14:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:40.958927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:40.974310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-aa81e29b-9c29-435e-9820-1918a06fbd31 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:40.975529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-aa81e29b-9c29-435e-9820-1918a06fbd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:40.981083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7494d-1760-402d-bcad-553f8916b6c3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:40.987141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 144/277] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 13:14:40.992016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:40.992826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:40.993111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:40.993383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:40.994539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:40.996497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:40.998370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 134/278] 10.222.0.16 () {56 vars in 1201 bytes} [Tue Oct 11 13:14:40 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:41.003815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81e29b-9c29-435e-9820-1918a06fbd31 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.016207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81e29b-9c29-435e-9820-1918a06fbd31 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.023198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.023869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.024185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.024506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.026158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:41.028461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:41.030443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 145/279] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:41.036129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.051873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff0ef3-f836-4644-af7d-baa3bb5e819f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.058948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.059626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.059903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.060175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312/groups/23b752f74f4b4d1bae791b67e8376470/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.062063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a210a78f477c407ba096da5266c3c312, group_id=23b752f74f4b4d1bae791b67e8376470, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:41.064727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:41.085987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 135/280] 10.222.0.16 () {58 vars in 1463 bytes} [Tue Oct 11 13:14:41 2022] PUT /identity/v3/projects/a210a78f477c407ba096da5266c3c312/groups/23b752f74f4b4d1bae791b67e8376470/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:41.301194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.311363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced140a6-75c1-4828-b787-b88d7e73a17a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.376119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.376770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.377092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.377359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.391064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:41.395990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:41.396851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:41.398228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 146/281] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:41.403207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.414162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a941-65fd-4df8-b4a3-1e4b9044df1d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.419609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.420238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.420558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.420827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.421499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:41.421795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:41.423577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:41.433829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 136/282] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:41.439597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.450911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cec96-c3bb-4126-8d92-a8be098314b0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.455520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.456240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.456516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.456781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.457879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:41.459986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:41.461811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 147/283] 10.222.0.16 () {56 vars in 1201 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:41.467397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.478500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026986-30d5-4150-86ba-65bc1e2beb75 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.483195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.483883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.484154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.484417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.485579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:41.487811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:41.489876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 137/284] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:41.495914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.506611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11249-8fe8-4c53-b8be-66a235fb7cd0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.511453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.512110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.512425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.512695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312/groups/23b752f74f4b4d1bae791b67e8376470/roles/60a9b9055fe947f6adfcc4173f804a58` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.514911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a210a78f477c407ba096da5266c3c312, group_id=23b752f74f4b4d1bae791b67e8376470, role_id=60a9b9055fe947f6adfcc4173f804a58)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:41.517679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:41.535762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 148/285] 10.222.0.16 () {58 vars in 1463 bytes} [Tue Oct 11 13:14:41 2022] PUT /identity/v3/projects/a210a78f477c407ba096da5266c3c312/groups/23b752f74f4b4d1bae791b67e8376470/roles/60a9b9055fe947f6adfcc4173f804a58 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:41.538206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.658413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d1b63-61b0-49f0-80f7-af4589bef66d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.697459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.698145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.698419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.698682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.706713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:41.712208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:41.718572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:41.719525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:41.720269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 138/286] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:41.725840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:41.756948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:41.833061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c3a6-e123-4624-8e56-5b7d30191e56 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:41.869521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:41.870142 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:41.870681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:41.870977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:41.871646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:41.871946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:41.873469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:41.883552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 149/287] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:41.889304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:42.002098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fd42a-2a83-4e1b-bef0-deba3dc532e7 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:42.037364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76edf50-fa0c-416f-bd48-6c7ceb75bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:42.038005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76edf50-fa0c-416f-bd48-6c7ceb75bf4e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.038276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76edf50-fa0c-416f-bd48-6c7ceb75bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.038876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76edf50-fa0c-416f-bd48-6c7ceb75bf4e None admin] PATH_INFO: `/v3/users/765bfaf979c343b992939f2836447da4` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.040051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76edf50-fa0c-416f-bd48-6c7ceb75bf4e None admin] RBAC: Authorizing `identity:get_user(user_id=765bfaf979c343b992939f2836447da4)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:42.041550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76edf50-fa0c-416f-bd48-6c7ceb75bf4e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:42.043496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 139/288] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:14:41 2022] GET /identity/v3/users/765bfaf979c343b992939f2836447da4 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:42.050827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:42.105384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b435b2-1067-42e9-aa62-bed2cbe7a5be None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.105700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b435b2-1067-42e9-aa62-bed2cbe7a5be None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.105920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b435b2-1067-42e9-aa62-bed2cbe7a5be None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.107342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 140/289] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:42.112501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a10b4-4673-4752-8ab1-76c6f9797454 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.112776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a10b4-4673-4752-8ab1-76c6f9797454 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.113043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a10b4-4673-4752-8ab1-76c6f9797454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.152118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8f3a10b4-4673-4752-8ab1-76c6f9797454 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:42.153720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8f3a10b4-4673-4752-8ab1-76c6f9797454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:42.213784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:42.228170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 141/290] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Oct 11 13:14:42.232560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a578c7-4f0a-4faf-bca5-a2a91c55b504 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:42.269876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:42.270412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.270690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.270993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.271714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] RBAC: Adding query filter params (role.id=2ce82b71b3ac44ceb433aaa512819a74, user.id=765bfaf979c343b992939f2836447da4, scope.system=all) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:42.272017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:42.273538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:42.293010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 150/291] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Oct 11 13:14:42 2022] GET /identity/v3/role_assignments?user.id=765bfaf979c343b992939f2836447da4&scope.system=all&role.id=2ce82b71b3ac44ceb433aaa512819a74 => generated 510 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:42.766236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a10b4-4673-4752-8ab1-76c6f9797454 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:42.779954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a10b4-4673-4752-8ab1-76c6f9797454 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:42.784882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:42.785780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.786244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.786706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.801678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:42.805646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:42.812837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:42.813696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:42.814449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 142/292] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:42.819862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:42.837272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740b93-5fe2-4205-858d-d24d9b0ed808 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:42.846338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:42.847008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.847293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.847559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.848262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:42.848568 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:42.850322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:42.866178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 151/293] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Oct 11 13:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:42.872239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:42.888324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe56aaa-7ad4-45d4-bfff-59b67acfbe2a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:42.896327 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:42.897026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.897299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.897566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] PATH_INFO: `/v3/groups/67a8499bca3f4ea69654e7890e36d679` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.903825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] RBAC: Authorizing `identity:get_group(group_id=67a8499bca3f4ea69654e7890e36d679)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:42.905811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:42.907485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 143/294] 10.222.0.16 () {56 vars in 1201 bytes} [Tue Oct 11 13:14:42 2022] GET /identity/v3/groups/67a8499bca3f4ea69654e7890e36d679 => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:42.913279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:42.928399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8e73-adc3-46bc-afa8-d1bca5015ea7 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:42.936193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38ca1f-6c98-4edb-96f1-39488d439107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:42.936835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ca1f-6c98-4edb-96f1-39488d439107 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.937112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ca1f-6c98-4edb-96f1-39488d439107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.937386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ca1f-6c98-4edb-96f1-39488d439107 admin admin] PATH_INFO: `/v3/projects/d012bcb449c3476b9eaca11563904099` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.938521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38ca1f-6c98-4edb-96f1-39488d439107 admin admin] RBAC: Authorizing `identity:get_project(project_id=d012bcb449c3476b9eaca11563904099)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:42.940420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38ca1f-6c98-4edb-96f1-39488d439107 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:42.943066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 152/295] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Oct 11 13:14:42 2022] GET /identity/v3/projects/d012bcb449c3476b9eaca11563904099 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:42.947999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:42.964182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cf7f9-a2f4-4677-ba59-d7589e4a7aba admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:42.969608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51416b-9e19-42b0-8702-6d447fd354e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:42.970374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51416b-9e19-42b0-8702-6d447fd354e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:42.970650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51416b-9e19-42b0-8702-6d447fd354e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:42.970979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51416b-9e19-42b0-8702-6d447fd354e2 admin admin] PATH_INFO: `/v3/projects/d012bcb449c3476b9eaca11563904099/groups/67a8499bca3f4ea69654e7890e36d679/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:42.972924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51416b-9e19-42b0-8702-6d447fd354e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d012bcb449c3476b9eaca11563904099, group_id=67a8499bca3f4ea69654e7890e36d679, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:42.975735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51416b-9e19-42b0-8702-6d447fd354e2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:42.996556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 144/296] 10.222.0.16 () {58 vars in 1463 bytes} [Tue Oct 11 13:14:42 2022] PUT /identity/v3/projects/d012bcb449c3476b9eaca11563904099/groups/67a8499bca3f4ea69654e7890e36d679/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:14:43.218713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a377-4925-47ad-ae45-6653f2eb0a61 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:43.219245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a377-4925-47ad-ae45-6653f2eb0a61 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:43.219315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a377-4925-47ad-ae45-6653f2eb0a61 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:43.220640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 153/297] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:43.226622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fcb91-59d3-4c48-8018-86bbef66bdbd None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:43.227001 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fcb91-59d3-4c48-8018-86bbef66bdbd None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:43.227280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fcb91-59d3-4c48-8018-86bbef66bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:43.247857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5e1fcb91-59d3-4c48-8018-86bbef66bdbd None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:43.249059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5e1fcb91-59d3-4c48-8018-86bbef66bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:43.352394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 145/298] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:43.562143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6bfa-e2b0-41f0-b724-7a1b629655ea None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:43.562481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6bfa-e2b0-41f0-b724-7a1b629655ea None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:43.562648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6bfa-e2b0-41f0-b724-7a1b629655ea None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:43.564288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 154/299] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:43.569478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4172b-2b73-43fa-a527-e2e555a61842 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:43.569758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4172b-2b73-43fa-a527-e2e555a61842 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:43.570026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4172b-2b73-43fa-a527-e2e555a61842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:43.591043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-36f4172b-2b73-43fa-a527-e2e555a61842 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:43.592220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-36f4172b-2b73-43fa-a527-e2e555a61842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:43.675567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 146/300] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:43.746947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e6bfa-e2b0-41f0-b724-7a1b629655ea None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:43.852965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e6bfa-e2b0-41f0-b724-7a1b629655ea None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:43.888048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:43.888681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:43.889001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:43.889266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:43.891112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:43.900910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:43.905803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:43.906666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:43.907510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 155/301] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:43.913183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4172b-2b73-43fa-a527-e2e555a61842 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:43.956082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:44.022745 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4172b-2b73-43fa-a527-e2e555a61842 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:44.068351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:44.068971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.069245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.069510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.070174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:44.070522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:44.071933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:44.082414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 147/302] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:44.092039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:44.236990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6318e0c-e6de-4f3b-970b-f4924eea2659 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:44.284270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:44.285267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.285741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.286228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.288170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:44.414265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:44.425466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:44.426973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:44.427432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ffcf-d32d-44df-991f-c5951d0e6a0c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:44.429061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:44.470191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:44.470852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.471334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.471613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.496776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:44.508540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:44.509477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:44.510254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:44.510880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 148/303] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:14:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:44.524147 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:44.621998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 156/304] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:44.629591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:44.679369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6702c-14b5-4c3b-ac1d-89de4bd1d97e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:44.726117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b827c-82d8-48bc-ac3d-ff06e8076127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:44.727723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b827c-82d8-48bc-ac3d-ff06e8076127 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.728222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b827c-82d8-48bc-ac3d-ff06e8076127 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.728936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b827c-82d8-48bc-ac3d-ff06e8076127 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.729817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b827c-82d8-48bc-ac3d-ff06e8076127 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:44.730306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b827c-82d8-48bc-ac3d-ff06e8076127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:44.731900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b827c-82d8-48bc-ac3d-ff06e8076127 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:44.742677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 149/305] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:44.744272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398729-1d1e-4cb6-b0e6-568bab95fda3 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.744768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398729-1d1e-4cb6-b0e6-568bab95fda3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.745249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398729-1d1e-4cb6-b0e6-568bab95fda3 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.751991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 150/306] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:44.753212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398729-1d1e-4cb6-b0e6-568bab95fda3 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:44.767700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:44.778132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7187ab3-d3c9-4e29-b4b2-8a640acd3ff6 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:44.788030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:44.822697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59271429-b22a-4be1-97a3-b82c3fccfe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:44.823874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59271429-b22a-4be1-97a3-b82c3fccfe82 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.824158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59271429-b22a-4be1-97a3-b82c3fccfe82 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.824427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59271429-b22a-4be1-97a3-b82c3fccfe82 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.825689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59271429-b22a-4be1-97a3-b82c3fccfe82 None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:44.827179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59271429-b22a-4be1-97a3-b82c3fccfe82 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:44.828815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 157/307] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:44 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:44.829931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc74e1-a02c-446b-b323-90191a16b77c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.830208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc74e1-a02c-446b-b323-90191a16b77c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.831107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc74e1-a02c-446b-b323-90191a16b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.850930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c6cc74e1-a02c-446b-b323-90191a16b77c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:44.852823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c6cc74e1-a02c-446b-b323-90191a16b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:44.887824 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398729-1d1e-4cb6-b0e6-568bab95fda3 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:44.926838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:44.927467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.927726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.927997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.928299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 158/308] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:44.929613 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef83b0-f509-4365-b17a-ec0ac3819216 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:44.930015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef83b0-f509-4365-b17a-ec0ac3819216 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:44.930431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef83b0-f509-4365-b17a-ec0ac3819216 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:44.931941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 159/309] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:44.932809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef83b0-f509-4365-b17a-ec0ac3819216 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.010706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:45.012537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:45.041272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.052655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.065557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef83b0-f509-4365-b17a-ec0ac3819216 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.113452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7dce7-8f04-4568-b49e-8fcf95d92e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.114451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7dce7-8f04-4568-b49e-8fcf95d92e2d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.115329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7dce7-8f04-4568-b49e-8fcf95d92e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.115820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7dce7-8f04-4568-b49e-8fcf95d92e2d None admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.117135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7dce7-8f04-4568-b49e-8fcf95d92e2d None admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:45.119359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7dce7-8f04-4568-b49e-8fcf95d92e2d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:45.121263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 160/310] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Oct 11 13:14:44 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:45.122627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a06e-0e60-499a-9ec1-80fcf23d447a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.123139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a06e-0e60-499a-9ec1-80fcf23d447a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.123603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a06e-0e60-499a-9ec1-80fcf23d447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.136589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 151/311] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:45.137454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.145398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-cb91a06e-0e60-499a-9ec1-80fcf23d447a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:45.146928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cb91a06e-0e60-499a-9ec1-80fcf23d447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:45.230065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 161/312] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:45.231315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a06e-0e60-499a-9ec1-80fcf23d447a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.273030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99850cd-79e9-4345-95f8-e64981fa7868 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.303284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.327320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.327632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.327814 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.328078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.328815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] RBAC: Adding query filter params (group.id=23b752f74f4b4d1bae791b67e8376470, role.id=80afb3528aef4ca38d372f9e8ea1c662, scope.project.id=6dc85f61719445e9848876aff636e33c) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:45.329122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:45.330569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:45.337671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 152/313] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/role_assignments?group.id=23b752f74f4b4d1bae791b67e8376470&scope.project.id=6dc85f61719445e9848876aff636e33c&role.id=80afb3528aef4ca38d372f9e8ea1c662 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:45.338579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.354752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.370623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a06e-0e60-499a-9ec1-80fcf23d447a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.414239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.415558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.415988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.416431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] PATH_INFO: `/v3/projects/6dc85f61719445e9848876aff636e33c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.417803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] RBAC: Authorizing `identity:get_project(project_id=6dc85f61719445e9848876aff636e33c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:45.419792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:45.422039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 162/314] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/projects/6dc85f61719445e9848876aff636e33c => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:45.427423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.508149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4974e8-74cc-4794-b054-afd75db60f06 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.563465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.564237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.564612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.564984 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.580697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:45.586738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:45.587629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:45.588372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 153/315] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:45.591682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.605562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcaedb-7f52-410a-8e98-c162f36393b1 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.650793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.651481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.651756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.652029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.653131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:45.654678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:45.656379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 163/316] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:45.656989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.657123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.691248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.727834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e7ab-9eef-4c41-aa62-51261c684e7d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.766413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.767184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.767459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.767722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.778594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:45.783508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:45.784397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:45.785146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 154/317] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:45.785778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.796981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0379-2512-4147-b1d2-907753abe470 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.834974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.835509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.835786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.836110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.836780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] RBAC: Adding query filter params (name=member) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:45.837082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:45.838470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:45.849608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 164/318] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:45.850533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.902944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380e87d-4e07-41f8-9620-07f7994aadb2 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:45.913126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.945586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60c8df-af6d-4b26-8b29-b195533702aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:45.945586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60c8df-af6d-4b26-8b29-b195533702aa None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.946271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60c8df-af6d-4b26-8b29-b195533702aa None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.946271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60c8df-af6d-4b26-8b29-b195533702aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.947488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60c8df-af6d-4b26-8b29-b195533702aa None admin] RBAC: Adding query filter params (group.id=23b752f74f4b4d1bae791b67e8376470, role.id=60a9b9055fe947f6adfcc4173f804a58, scope.project.id=6dc85f61719445e9848876aff636e33c) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:45.947488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60c8df-af6d-4b26-8b29-b195533702aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:45.948611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60c8df-af6d-4b26-8b29-b195533702aa None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:45.954864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 155/319] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/role_assignments?group.id=23b752f74f4b4d1bae791b67e8376470&scope.project.id=6dc85f61719445e9848876aff636e33c&role.id=60a9b9055fe947f6adfcc4173f804a58 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:45.955689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782b12-68c4-4848-80d5-f08fffe406a2 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:45.955970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782b12-68c4-4848-80d5-f08fffe406a2 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:45.956259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782b12-68c4-4848-80d5-f08fffe406a2 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:45.957483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 156/320] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:45.958188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3782b12-68c4-4848-80d5-f08fffe406a2 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:45.963170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:45.971676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084fd24-fcdd-41bf-9785-e75551f49b04 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.021605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079c6ec-3dfc-4714-be09-10d4965fa1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.022226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079c6ec-3dfc-4714-be09-10d4965fa1ab None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.022502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079c6ec-3dfc-4714-be09-10d4965fa1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.022769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079c6ec-3dfc-4714-be09-10d4965fa1ab None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.023556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079c6ec-3dfc-4714-be09-10d4965fa1ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:46.024058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079c6ec-3dfc-4714-be09-10d4965fa1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:46.025935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079c6ec-3dfc-4714-be09-10d4965fa1ab None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:46.037553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 165/321] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:46.039390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb930607-6b7d-401f-b359-32665469ff9e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.039694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb930607-6b7d-401f-b359-32665469ff9e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.039983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb930607-6b7d-401f-b359-32665469ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.063398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-eb930607-6b7d-401f-b359-32665469ff9e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:46.065419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-eb930607-6b7d-401f-b359-32665469ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:46.088979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3782b12-68c4-4848-80d5-f08fffe406a2 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.145632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.146261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.146645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.149866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.163355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 166/322] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:46.164986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb930607-6b7d-401f-b359-32665469ff9e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.207180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:46.246478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:46.248054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:46.269284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:46.296931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb930607-6b7d-401f-b359-32665469ff9e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.333395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.334103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.334471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.334797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.392026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 157/323] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:46.398588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.418369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:46.420497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:46.488443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:46.515025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:46.525047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7fe86-8f73-4fef-b2ef-2e9b1b2b7b96 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.534608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 167/324] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:46.535490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.564752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.565395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.567581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.567581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.567581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:46.568480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:46.570438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 158/325] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:46.571245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.652246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac029ab1-75ec-49a6-88b9-6926908f521c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.683042 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00072b6-4835-4f65-ae56-a10a9596432f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.694505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.695433 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.696018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.696815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.711696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:46.716647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:46.717707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 168/326] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:46.718659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.723603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.724443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.724725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.724995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] PATH_INFO: `/v3/projects/a210a78f477c407ba096da5266c3c312` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.726115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] RBAC: Authorizing `identity:get_project(project_id=a210a78f477c407ba096da5266c3c312)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:46.728971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:46.730664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 159/327] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/projects/a210a78f477c407ba096da5266c3c312 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:46.733324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.745650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:46.770970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:46.832979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2689d3-d18f-4561-87e6-60f81d808b8c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.839081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c5e5-5327-4702-ab0e-2866adee8758 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.865576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.866277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.866622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.866928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.868117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:46.869586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:46.871202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 169/328] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:46.876175 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.876302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:46.876302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:46.876302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:46.876302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:46.876593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:46.876593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:46.876593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:46.886876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 160/329] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:46.886876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:46.949680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:46.975700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3631f-5c32-4e92-b79e-5e16cfcf4528 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.981379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369aaea-0cfc-43d6-bd9a-3ef80060cbc2 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:46.984789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:47.010606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:47.011268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:47.011549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:47.011814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] PATH_INFO: `/v3/groups/23b752f74f4b4d1bae791b67e8376470` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:47.012977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] RBAC: Authorizing `identity:get_group(group_id=23b752f74f4b4d1bae791b67e8376470)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:47.014025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:47.014367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:47.014627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:47.014936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:47.015201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:47.015915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] RBAC: Adding query filter params (group.id=23b752f74f4b4d1bae791b67e8376470, role.id=80afb3528aef4ca38d372f9e8ea1c662, scope.project.id=a210a78f477c407ba096da5266c3c312) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:47.016001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 170/330] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/groups/23b752f74f4b4d1bae791b67e8376470 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:47.016218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:47.016730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:47.017634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:47.030872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 161/331] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Oct 11 13:14:46 2022] GET /identity/v3/role_assignments?group.id=23b752f74f4b4d1bae791b67e8376470&scope.project.id=a210a78f477c407ba096da5266c3c312&role.id=80afb3528aef4ca38d372f9e8ea1c662 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:47.030872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:47.134314 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30104a04-5c0f-4742-8737-d9ef9549a82d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:47.147936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d780-7d5e-4a5d-9ff0-ddb14020a3b5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:47.175075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:47.175865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:47.176257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:47.176534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:47.188546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:47.189162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:47.189436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:47.189702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:47.190424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] RBAC: Adding query filter params (group.id=23b752f74f4b4d1bae791b67e8376470, role.id=60a9b9055fe947f6adfcc4173f804a58, scope.project.id=a210a78f477c407ba096da5266c3c312) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:47.190729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:47.192203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:47.194139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:47.200852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 162/332] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Oct 11 13:14:47 2022] GET /identity/v3/role_assignments?group.id=23b752f74f4b4d1bae791b67e8376470&scope.project.id=a210a78f477c407ba096da5266c3c312&role.id=60a9b9055fe947f6adfcc4173f804a58 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:47.233542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:47.264827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:47.266336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:47.380795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 171/333] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:14:47.386724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:47.499584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3d97-77cf-46cb-8f63-b378e7105896 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:47.532433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:47.533061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:47.533335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:47.533597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] PATH_INFO: `/v3/projects/d012bcb449c3476b9eaca11563904099` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:47.534781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] RBAC: Authorizing `identity:get_project(project_id=d012bcb449c3476b9eaca11563904099)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:47.536231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:47.538025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 163/334] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:14:47 2022] GET /identity/v3/projects/d012bcb449c3476b9eaca11563904099 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:47.544029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:47.618932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:47.640810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4d07a-8848-445b-9cdd-cd7f1c42771d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:47.675793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64500-5fd7-445a-8330-8d648764ee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:47.676405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64500-5fd7-445a-8330-8d648764ee7a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:47.676676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64500-5fd7-445a-8330-8d648764ee7a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:47.676940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64500-5fd7-445a-8330-8d648764ee7a None admin] PATH_INFO: `/v3/groups/67a8499bca3f4ea69654e7890e36d679` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:47.678152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64500-5fd7-445a-8330-8d648764ee7a None admin] RBAC: Authorizing `identity:get_group(group_id=67a8499bca3f4ea69654e7890e36d679)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:47.679613 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64500-5fd7-445a-8330-8d648764ee7a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:47.681339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 172/335] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Oct 11 13:14:47 2022] GET /identity/v3/groups/67a8499bca3f4ea69654e7890e36d679 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:47.687643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:47.754679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:47.790205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef20ac-7c67-499d-a122-205fc11362fb None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:47.823960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4902b7b-0f6f-41e9-8a03-c3e3b8d0bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:47.824541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902b7b-0f6f-41e9-8a03-c3e3b8d0bc5f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:47.824810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902b7b-0f6f-41e9-8a03-c3e3b8d0bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:47.825067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902b7b-0f6f-41e9-8a03-c3e3b8d0bc5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:47.825776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4902b7b-0f6f-41e9-8a03-c3e3b8d0bc5f None admin] RBAC: Adding query filter params (group.id=67a8499bca3f4ea69654e7890e36d679, role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=d012bcb449c3476b9eaca11563904099) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:47.826077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4902b7b-0f6f-41e9-8a03-c3e3b8d0bc5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:47.827518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4902b7b-0f6f-41e9-8a03-c3e3b8d0bc5f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:47.833230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 164/336] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Oct 11 13:14:47 2022] GET /identity/v3/role_assignments?group.id=67a8499bca3f4ea69654e7890e36d679&scope.project.id=d012bcb449c3476b9eaca11563904099&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:50.349019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52118c6-2685-4e52-b5d3-4e2743e46955 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:50.349978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52118c6-2685-4e52-b5d3-4e2743e46955 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:50.350457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52118c6-2685-4e52-b5d3-4e2743e46955 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:50.352383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 173/337] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:50.358120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69221cd-615b-47f2-b358-d2f13a41476a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:50.359115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69221cd-615b-47f2-b358-d2f13a41476a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:50.359589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69221cd-615b-47f2-b358-d2f13a41476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:50.379663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a69221cd-615b-47f2-b358-d2f13a41476a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:50.381249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a69221cd-615b-47f2-b358-d2f13a41476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:50.452686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 165/338] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:50.559666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516bfe5-f3d5-4c29-8702-7042edf9d3d1 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:50.560292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516bfe5-f3d5-4c29-8702-7042edf9d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:50.560763 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516bfe5-f3d5-4c29-8702-7042edf9d3d1 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:50.562653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 174/339] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:50.568848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d756-9447-4acf-9329-dd5ce5668a52 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:50.569417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d756-9447-4acf-9329-dd5ce5668a52 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:50.569883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d756-9447-4acf-9329-dd5ce5668a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:50.599893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e754d756-9447-4acf-9329-dd5ce5668a52 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:50.601401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e754d756-9447-4acf-9329-dd5ce5668a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:50.607880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1ba3c-15a2-48a7-b00e-6af6b37ecc5f None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:50.608461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1ba3c-15a2-48a7-b00e-6af6b37ecc5f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:50.608919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1ba3c-15a2-48a7-b00e-6af6b37ecc5f None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:50.610689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 175/340] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:50.616172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973cdb1-35c9-4dfd-bfb8-0b6c5b62a45a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:50.616618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973cdb1-35c9-4dfd-bfb8-0b6c5b62a45a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:50.617053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973cdb1-35c9-4dfd-bfb8-0b6c5b62a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:50.645949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-8973cdb1-35c9-4dfd-bfb8-0b6c5b62a45a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:50.648223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8973cdb1-35c9-4dfd-bfb8-0b6c5b62a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:50.695575 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:50.713805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 166/341] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:50.771389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 176/342] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:50.800766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754d756-9447-4acf-9329-dd5ce5668a52 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:50.914980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754d756-9447-4acf-9329-dd5ce5668a52 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:50.959012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:50.960033 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:50.960526 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:50.961793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:50.975558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:50.977307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:50.993455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:50.994405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:50.995270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:50.995270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:50.995270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:50.997320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 167/343] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:51.003541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973cdb1-35c9-4dfd-bfb8-0b6c5b62a45a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.043376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.095287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:51.113086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:51.135179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973cdb1-35c9-4dfd-bfb8-0b6c5b62a45a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.176329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9acd8-7667-426e-a518-1c8f88bfedcf None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.188084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.188920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.189347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.189757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.190620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:51.191107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.192635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.209394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 177/344] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:51.210775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.212698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.213342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.213617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.213894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.225638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.227489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:51.243465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:51.244549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:51.245598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:51.245598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:51.245598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:51.245598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 168/345] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:51.245818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.316681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5133-4766-4782-a081-ef49144ffdcf None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.355965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.357337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.357756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.358165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.360837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:51.361723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:51.369232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d56a71-6a20-46c0-aaf3-e725d081a968 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.372133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.373747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:51.389054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:51.390138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:51.391166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:51.391166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:51.391166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:51.392525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 178/346] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:51.398778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.406215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.406844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.407151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.407475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.408129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.409679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.443233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 169/347] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:51 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:51.444463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.513242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37bde2-61f8-4582-bd85-c844e524a1d0 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.551228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aafc5-aa15-485a-91eb-b56fc1266b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.551844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aafc5-aa15-485a-91eb-b56fc1266b5d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.552282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aafc5-aa15-485a-91eb-b56fc1266b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.552696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aafc5-aa15-485a-91eb-b56fc1266b5d None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.553520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aafc5-aa15-485a-91eb-b56fc1266b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:51.553966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aafc5-aa15-485a-91eb-b56fc1266b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.555815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aafc5-aa15-485a-91eb-b56fc1266b5d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.573843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 179/348] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:51.575460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe549fd-94bf-4538-9c99-0a1f7aafd904 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.575981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe549fd-94bf-4538-9c99-0a1f7aafd904 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.576443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe549fd-94bf-4538-9c99-0a1f7aafd904 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.578076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 180/349] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:51.583629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe549fd-94bf-4538-9c99-0a1f7aafd904 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.592935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4aec5-8047-407e-971b-cdbeb9acb98e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.630585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685f8b0-a1ad-4a95-8b6b-708d9bd2636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.631474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f8b0-a1ad-4a95-8b6b-708d9bd2636a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.631889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f8b0-a1ad-4a95-8b6b-708d9bd2636a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.632293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f8b0-a1ad-4a95-8b6b-708d9bd2636a None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.633151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f8b0-a1ad-4a95-8b6b-708d9bd2636a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:51.633827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f8b0-a1ad-4a95-8b6b-708d9bd2636a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.635456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f8b0-a1ad-4a95-8b6b-708d9bd2636a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.648633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 170/350] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:51.651067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815e36a-c9c4-4e09-8e8f-3774b5545988 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.651425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815e36a-c9c4-4e09-8e8f-3774b5545988 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.651548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815e36a-c9c4-4e09-8e8f-3774b5545988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.652930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:51.672950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a815e36a-c9c4-4e09-8e8f-3774b5545988 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:51.674159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a815e36a-c9c4-4e09-8e8f-3774b5545988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:51.677743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:51.728521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe549fd-94bf-4538-9c99-0a1f7aafd904 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.758993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 171/351] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:51.760059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815e36a-c9c4-4e09-8e8f-3774b5545988 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:51.775177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.775800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.776094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.776867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.777523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.779493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.821654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 181/352] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:51 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:51.879143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815e36a-c9c4-4e09-8e8f-3774b5545988 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:51.916977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:51.917672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:51.917951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:51.918215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:51.918913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:51.920398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:51.934798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:51.949322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 172/353] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:51 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:52.064254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:52.186439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa2a6-f746-4f80-987b-121838efab82 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:52.188498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:52.225400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f8fdc-9cd4-4365-ab09-ee355390ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:52.226089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f8fdc-9cd4-4365-ab09-ee355390ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:52.226360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f8fdc-9cd4-4365-ab09-ee355390ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:52.226734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f8fdc-9cd4-4365-ab09-ee355390ecc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:52.238132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f8fdc-9cd4-4365-ab09-ee355390ecc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:52.239666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f8fdc-9cd4-4365-ab09-ee355390ecc2 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-1e6f8fdc-9cd4-4365-ab09-ee355390ecc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:52.255852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:52.256822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:52.257682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:52.257682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:52.257682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:52.257682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 182/354] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:52.263218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:52.307424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fd363-28a1-46c5-ad4b-df844db9fcf4 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:52.307746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fd363-28a1-46c5-ad4b-df844db9fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:52.307965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fd363-28a1-46c5-ad4b-df844db9fcf4 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:52.309531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 183/355] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:14:52.316559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461ecd-49c1-490a-9f1f-043bd2eeee9d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:52.316817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461ecd-49c1-490a-9f1f-043bd2eeee9d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:52.317005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461ecd-49c1-490a-9f1f-043bd2eeee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:52.343420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-32461ecd-49c1-490a-9f1f-043bd2eeee9d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:52.345749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-32461ecd-49c1-490a-9f1f-043bd2eeee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:52.430047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a1512-183e-4500-a895-824aa2e4928f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:52.465099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 184/356] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:52.495968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:52.496619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:52.496957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:52.497233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:52.497957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:52.498264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:52.499745 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:52.519092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 173/357] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:14:52.524415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461ecd-49c1-490a-9f1f-043bd2eeee9d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:52.627341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:52.651003 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461ecd-49c1-490a-9f1f-043bd2eeee9d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:52.695910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:52.696575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:52.696856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:52.697125 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:52.697776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:52.699245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:52.725692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 185/358] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:52 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:52.961581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:53.022008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:53.067891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d86d7-e8ec-437c-99a5-71b99de3077f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:53.103889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:53.104519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:53.104789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:53.105057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:53.105741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:53.107251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:53.116958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.sql.core [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 13:14:53.116958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 11 13:14:53.116958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [parameters: {'id': '73ef059c405147ec93175103e4989b1a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 11 13:14:53.116958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81401) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:14:53.133577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return ref.to_dict() Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:14:53.134625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application yield resource Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise self.value Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application session.commit() Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 13:14:53.135565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.flush() Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application compat.raise_( Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:14:53.136361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:14:53.137182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:14:53.140345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [parameters: {'id': '73ef059c405147ec93175103e4989b1a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:53.142482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 11 13:14:53.145586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:53.149031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 174/359] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Oct 11 13:14:52 2022] POST /identity/v3/roles => generated 144 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:53.149178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:53.248107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54027e1-8a93-4396-b2fb-7f016a48ca8c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:53.296670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3513c-585f-475f-8027-49ccf6cebb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:53.297318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3513c-585f-475f-8027-49ccf6cebb4d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:53.297593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3513c-585f-475f-8027-49ccf6cebb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:53.297881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3513c-585f-475f-8027-49ccf6cebb4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:53.310153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:53.313936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3513c-585f-475f-8027-49ccf6cebb4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-f2b3513c-585f-475f-8027-49ccf6cebb4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:53.322126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:53.323122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 13:14:53.323886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:53.326424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 186/360] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:14:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:53.336379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:53.454360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5bfb-09ef-4a8a-86c6-9482af937d37 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:53.475946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:53.490836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e11ef-8b2e-4f74-9eda-f3855ee92e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:53.491452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e11ef-8b2e-4f74-9eda-f3855ee92e0c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:53.491724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e11ef-8b2e-4f74-9eda-f3855ee92e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:53.492029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e11ef-8b2e-4f74-9eda-f3855ee92e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:53.492722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e11ef-8b2e-4f74-9eda-f3855ee92e0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:53.493027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e11ef-8b2e-4f74-9eda-f3855ee92e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:53.494412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e11ef-8b2e-4f74-9eda-f3855ee92e0c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:53.503870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 175/361] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:53.987778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c451-aa47-4b6b-b58e-03c5754276b7 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:53.988865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c451-aa47-4b6b-b58e-03c5754276b7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:53.989154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c451-aa47-4b6b-b58e-03c5754276b7 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:53.991907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 187/362] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:53.997961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da033-d2d0-49d7-8cb5-94ca1a46c20b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:53.998530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da033-d2d0-49d7-8cb5-94ca1a46c20b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:53.999046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da033-d2d0-49d7-8cb5-94ca1a46c20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:54.019081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8e0da033-d2d0-49d7-8cb5-94ca1a46c20b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:54.020609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8e0da033-d2d0-49d7-8cb5-94ca1a46c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:54.098056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 176/363] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:54.437739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7aac1-4626-4a95-92a5-76efafb03728 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:54.438122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7aac1-4626-4a95-92a5-76efafb03728 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:54.438308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7aac1-4626-4a95-92a5-76efafb03728 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:54.439975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 188/364] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:54.445355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6842a-7d88-41ec-ba4c-5292fa72ebec None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:54.445633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6842a-7d88-41ec-ba4c-5292fa72ebec None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:54.445899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6842a-7d88-41ec-ba4c-5292fa72ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:54.463752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7aac1-4626-4a95-92a5-76efafb03728 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:54.475042 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-02b6842a-7d88-41ec-ba4c-5292fa72ebec None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:54.476251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-02b6842a-7d88-41ec-ba4c-5292fa72ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:54.587267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 177/365] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:54.646055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7aac1-4626-4a95-92a5-76efafb03728 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:54.688967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e5729-1e05-4e71-bd18-5d24c45e3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:54.689604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5729-1e05-4e71-bd18-5d24c45e3558 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:54.689875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5729-1e05-4e71-bd18-5d24c45e3558 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:54.690133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5729-1e05-4e71-bd18-5d24c45e3558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:54.705694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e5729-1e05-4e71-bd18-5d24c45e3558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-572e5729-1e05-4e71-bd18-5d24c45e3558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:54.710557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:54.711605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:54.712373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 189/366] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:54.723961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6842a-7d88-41ec-ba4c-5292fa72ebec None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:54.732733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a78fe-3821-47c3-9bdd-6e9a41469567 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:54.733013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a78fe-3821-47c3-9bdd-6e9a41469567 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:54.733273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a78fe-3821-47c3-9bdd-6e9a41469567 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:54.734761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 190/367] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:54.739803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1991-050c-417a-878e-f6e7b45c714a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:54.740078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1991-050c-417a-878e-f6e7b45c714a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:54.740359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1991-050c-417a-878e-f6e7b45c714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:54.758725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-182a1991-050c-417a-878e-f6e7b45c714a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:54.759930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-182a1991-050c-417a-878e-f6e7b45c714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:54.793739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:54.818532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:54.831802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 191/368] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:14:54.905476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6842a-7d88-41ec-ba4c-5292fa72ebec None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:54.943912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a1991-050c-417a-878e-f6e7b45c714a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:54.951539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:54.952164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:54.952443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:54.952713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:54.953387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:54.953685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:54.955143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:54.964152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 178/369] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:54.969771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.100886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a1991-050c-417a-878e-f6e7b45c714a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.135415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50149128-784d-425f-8c51-b8b4d8e02c1f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.138967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:55.151567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.153242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.153814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.154269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.171386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:55.175733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.176461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.176794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.177123 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:55.178428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:55.179316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:55.180328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:55.183738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 192/370] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:55.184805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.192113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.193661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:55.211320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:55.212376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:55.213414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:55.213414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:55.213414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:55.214801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 179/371] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:55.215810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.255711 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:55.318988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077df75c-59de-466c-9e1e-8f1b7e2681ff None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.323976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecd85b-cc3b-4d37-96a5-bc86bb09b0e9 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.371157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.371821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.372097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.372361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.373066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:55.373371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.374727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.377555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.378423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.378941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.379414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.383663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 180/372] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:55.384622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.393384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:55.400816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:55.401693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:55.402500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:55.406868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 193/373] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:55.408064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.414621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:55.499794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cdd44-6380-44f2-b0d3-c5f4394749ea None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.536455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.537055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.537325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.537588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.538230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:55.538855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.540272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.550803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e42bf-97c8-4ea2-a662-d82cfdfa41d6 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.552707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 181/374] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:55.553313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.565689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:55.597716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.599367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.599851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.600311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.613906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.615639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:55.632608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:55.633610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:55.634706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:55.634706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:55.634706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:55.634706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 194/375] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:55.636019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.653919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:55.682214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506602f-fb7b-4e66-a5d2-0ab27b30c562 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.726253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.726959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.727334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.727654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.728635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:55.728932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.730278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.742945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 182/376] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:55.742945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.743641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3352-bee0-412b-a168-c2c750e4c856 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.777600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9c084-87fd-4e77-a5e8-cf96af793bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.778148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9c084-87fd-4e77-a5e8-cf96af793bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.778421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9c084-87fd-4e77-a5e8-cf96af793bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.778686 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9c084-87fd-4e77-a5e8-cf96af793bb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.786052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9c084-87fd-4e77-a5e8-cf96af793bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.787526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9c084-87fd-4e77-a5e8-cf96af793bb8 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-72b9c084-87fd-4e77-a5e8-cf96af793bb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:14:55.800277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:55.801184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:55.802052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 195/377] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:55.802632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5af2-0c4c-4d1d-93eb-e9876a93e8a0 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.803470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5af2-0c4c-4d1d-93eb-e9876a93e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.803470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5af2-0c4c-4d1d-93eb-e9876a93e8a0 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.806861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 196/378] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:55.806861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5af2-0c4c-4d1d-93eb-e9876a93e8a0 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.831740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:55.856512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3e8-129b-49db-883b-04705468085e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.892881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.893509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.893770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.894049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.894682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:55.895026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.896404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.906322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:55.912855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5af2-0c4c-4d1d-93eb-e9876a93e8a0 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:55.915106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 183/379] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:55.915820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:55.954630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad3d1a-cb60-43ca-8a35-5f6539ea3aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:55.955298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3d1a-cb60-43ca-8a35-5f6539ea3aea None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.955570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3d1a-cb60-43ca-8a35-5f6539ea3aea None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.955873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3d1a-cb60-43ca-8a35-5f6539ea3aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:55.970762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad3d1a-cb60-43ca-8a35-5f6539ea3aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:55.972619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad3d1a-cb60-43ca-8a35-5f6539ea3aea None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-e1ad3d1a-cb60-43ca-8a35-5f6539ea3aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:55.987563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:55.988488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:55.990080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:55.990080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:55.990080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:55.990080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 197/380] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:55.990291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cfb77-f739-4a1c-9289-c744cc69082b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:55.990502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cfb77-f739-4a1c-9289-c744cc69082b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:55.990648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cfb77-f739-4a1c-9289-c744cc69082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.008759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a95cfb77-f739-4a1c-9289-c744cc69082b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:56.009931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a95cfb77-f739-4a1c-9289-c744cc69082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:56.026950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a46eef-c7a4-4c4b-b7d9-61a4e8c2f55c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.064035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.064890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.065167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.065431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.066165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:56.066469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.067956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.090849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 198/381] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:56.090849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cfb77-f739-4a1c-9289-c744cc69082b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.093355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.113781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 184/382] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Oct 11 13:14:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:56.114563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.180475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.229115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cfb77-f739-4a1c-9289-c744cc69082b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.230062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f621-98a3-4dc1-b55a-a56a2ddb4b11 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.266868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.267699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.268073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.268440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.271707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.272329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.272605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.272877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.273616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:56.273919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.275348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.276917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.278722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.289168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 185/383] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:56.290011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:14:56.296651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:56.297656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 11 13:14:56.298501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:56.299020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 199/384] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:56.304368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.389451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.412623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b921d-c0cd-4222-a110-d64a9c3c0ec3 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.428187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87e36-cb0b-42dd-a3e8-55a591b80997 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.432967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.453949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.454848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.455508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.455857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.463117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.463752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.464030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.464301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.467376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.468829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.472111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.473553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:56.483944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:56.489571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:56.490483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:56.490483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:56.490483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:14:56.490673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:56.491655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 13:14:56.493052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:56.493737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 186/385] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:56.493737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.493874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 200/386] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:56.493874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.588614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026f2e2-b07a-4b56-bbb5-f32ec67cd1b5 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.592255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8fc07-d475-44f6-b5b5-ff0686afbace None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.610951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.624021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82a9ea-130a-45ca-ae20-103af8697a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.624662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82a9ea-130a-45ca-ae20-103af8697a44 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.624935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82a9ea-130a-45ca-ae20-103af8697a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.625191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82a9ea-130a-45ca-ae20-103af8697a44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.625876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.626493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.626758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.627073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.627807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:56.628114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.629562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.635410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82a9ea-130a-45ca-ae20-103af8697a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5e82a9ea-130a-45ca-ae20-103af8697a44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:14:56.640858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:56.641861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:56.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 201/387] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:56.643594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e12b-34d2-4a94-92b7-f15453a63524 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.643753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e12b-34d2-4a94-92b7-f15453a63524 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.644019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e12b-34d2-4a94-92b7-f15453a63524 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.649532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 202/388] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:14:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:14:56.649532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e12b-34d2-4a94-92b7-f15453a63524 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.652199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 187/389] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:56.653057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.681672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.748805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e12b-34d2-4a94-92b7-f15453a63524 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.752877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664fb6-76b2-4148-b60e-4649b853f2ea None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.782536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.783168 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.783443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.783713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.784351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:56.784653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.785934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7d404-9b95-44eb-acd0-d00e8bcae519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.786051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.786533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7d404-9b95-44eb-acd0-d00e8bcae519 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.786804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7d404-9b95-44eb-acd0-d00e8bcae519 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.787103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7d404-9b95-44eb-acd0-d00e8bcae519 None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.787815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7d404-9b95-44eb-acd0-d00e8bcae519 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:56.788113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7d404-9b95-44eb-acd0-d00e8bcae519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.789873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7d404-9b95-44eb-acd0-d00e8bcae519 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.797822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 203/390] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:56.798528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.811056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 188/391] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:56.812258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbdb0a-7e19-43cc-bb18-f8f8a6620047 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.812541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbdb0a-7e19-43cc-bb18-f8f8a6620047 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.812807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbdb0a-7e19-43cc-bb18-f8f8a6620047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.830735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cbbbdb0a-7e19-43cc-bb18-f8f8a6620047 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:14:56.831949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cbbbdb0a-7e19-43cc-bb18-f8f8a6620047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:14:56.845766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.897386 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 189/392] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:14:56.898048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbdb0a-7e19-43cc-bb18-f8f8a6620047 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:56.902399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9da9a-d24b-4903-8caa-3010cc87ea37 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:56.915805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:56.939084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:56.939701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:56.939979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:56.940245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:56.940904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:56.941193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:56.942583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:56.951397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 204/393] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:56.952209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.005665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbdb0a-7e19-43cc-bb18-f8f8a6620047 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.042105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.042836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.043202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.043541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.054578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.055630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3c63-64f5-4094-95fa-4d2ed6aba2e4 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.056086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.062941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:57.073119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:57.074062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:57.074909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:57.074909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.074909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:57.074909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 190/394] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:57.075127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.095876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.096426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.096697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.096962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.103681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.105113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:14:57.116664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:57.117764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 205/395] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:57.123435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.152541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.187953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262df6c-d8f1-4811-99fa-b7e3db2f765d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.221552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.222189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.222465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.222731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.225895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8b17-518e-4d3b-8b63-8e7149cd6d5b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.234203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.235687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:57.251486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:57.252596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:57.253865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:57.253865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.253865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:57.253865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 191/396] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:57.253865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.261636 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.262252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.262523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.262794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.273335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.274785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:57.288781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:57.289694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:57.290507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:57.290507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.290507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:57.290507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 206/397] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:57.290722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.312775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.356359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c74b93-b281-4e6c-9466-330979cf49ae None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.375397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.389868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.390472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.390747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.391047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.391681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:57.391978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.393338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.394837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32115d-5159-4020-9b7d-e7f198353bbf None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.404953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 192/398] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:57.405743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.434742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.435379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.435654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.435923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.436664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:57.436964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.438464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.456595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 207/399] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:57.457511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.508411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092a17-efa9-49b4-88e4-6938d8798614 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.531598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.543099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.543728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.544003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.544268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.553775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f151da-41b4-4692-bea7-ee1f9ebdd73d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.554616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.556090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:57.570352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:57.571443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:57.572354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:57.572354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:57.572354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:57.572354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 193/400] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:57.572354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.592732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.593343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.593618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.593894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.594528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:57.594849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.596246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.603513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.607864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 208/401] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:57.608846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.672088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477555-877c-4841-bf6b-932cb2fa6cf6 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.705284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.705678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7744ae-967d-483a-bea6-6c47c551118d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.705892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.706166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.706430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.707097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:57.707396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.708746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.720556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 194/402] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:57.721318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.743220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.743851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.744130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.744410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.751131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.752590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.754219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:14:57.764825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:57.765709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:57.766557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 209/403] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:57.767045 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.813411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:57.822769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185a252-4c91-413c-ba49-7bb533f5a17f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.856420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.857081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.857355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.857624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/c81304f420a447a1a488a941d4075513/roles/d58da09371854b4ab217716b0492fb82` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.863165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deab15-bab8-4a36-b091-58d5b786f36c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:57.872340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=c81304f420a447a1a488a941d4075513, role_id=d58da09371854b4ab217716b0492fb82)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.873783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.887457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 195/404] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:57 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/c81304f420a447a1a488a941d4075513/roles/d58da09371854b4ab217716b0492fb82 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:57.888269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.905059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:57.906100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:57.906481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:57.906787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:57.907355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:57.907664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:57.909103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:57.922947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 210/405] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:57.928484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:57.993760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:58.006028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b803-3be9-444f-b242-6178c27e5382 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.039862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a878b0f-7c9f-409a-bc86-f574d1ce853b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.043845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.044609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.044979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.045338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.053217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.054877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:14:58.068083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:58.069145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:58.070271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 196/406] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:58.070802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.073605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:58.085172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.086038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.086437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.086970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.095900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.097394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:14:58.109166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:58.110147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 13:14:58.111074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:14:58.112017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 211/407] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:14:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:58.112767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.183946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ced96f-da89-4b8a-9885-b5c2c3edacfa None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.216947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca39de-f74b-472a-8946-44bb61c6208b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.219108 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.220200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.220200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.220413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.220909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:58.221210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.222644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.235435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:58.245552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 197/408] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:58.245552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.257895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.258361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.258783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.259165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.259900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.261416 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.290884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 212/409] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:14:58 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:14:58.290884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.317184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:58.374709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f49fe-080d-46fa-accf-fffbbd3a6856 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.426462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87017717-a55a-42e0-9fb8-d87cc605c036 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.432717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.433581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.434075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.434484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.435516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:58.436656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.438738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.458051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 198/410] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:58.459607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.467508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.468283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.468651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.469033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.469910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:58.470308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.472023 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.511719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 213/411] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Oct 11 13:14:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:58.513680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.550394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:58.594840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dbc1a-c06f-4d36-a0bb-a704721501a6 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.621930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1cb0-aa9a-4261-845c-709dc1a90cab None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.641693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.642367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.642651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.642978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/1a06e2819ffa4bbcaaf07f8b962c531c/roles/d58da09371854b4ab217716b0492fb82` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.660590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=1a06e2819ffa4bbcaaf07f8b962c531c, role_id=d58da09371854b4ab217716b0492fb82)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.662193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.662717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.663774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.664287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.664570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/e466d119406f489b962596b7cd9fb7e5/roles/d58da09371854b4ab217716b0492fb82` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.670280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:58.682202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=e466d119406f489b962596b7cd9fb7e5, role_id=d58da09371854b4ab217716b0492fb82)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.684160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.685253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 199/412] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:58 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/1a06e2819ffa4bbcaaf07f8b962c531c/roles/d58da09371854b4ab217716b0492fb82 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:58.686361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.712272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 214/413] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:58 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/e466d119406f489b962596b7cd9fb7e5/roles/d58da09371854b4ab217716b0492fb82 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:14:58.810967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7a2a6-9b84-4fd3-87e8-7ea200d18f31 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:58.852744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:58.853415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:58.853684 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:58.853945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:58.866203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:58.867819 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:14:58.884433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:58.885394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:14:58.886199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:14:58.886199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:14:58.886199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:58.886199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 200/414] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:14:58.891323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:58.983213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:59.002549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790283b6-fb1c-4d42-a8ff-29ee367dee85 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:59.042069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:59.042689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:59.043006 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:59.043276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:59.043919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:59.044219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:59.045623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:59.057774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 215/415] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:59.062851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:59.094231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:59.178408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c4dd6-ebec-4c36-8cab-6dc60fc1727f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:59.211846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:59.212490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:59.212766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:59.213035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:59.220106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:59.221547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:14:59.233342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:14:59.234152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:14:59.235580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 201/416] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:14:59.240075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:59.387272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30397d72-302b-4453-9ff1-e8c0369318af None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:59.427235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5203c-a584-4f86-9ef7-32798576ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:59.427841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5203c-a584-4f86-9ef7-32798576ad7c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:59.428114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5203c-a584-4f86-9ef7-32798576ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:59.428382 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5203c-a584-4f86-9ef7-32798576ad7c None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:59.429071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5203c-a584-4f86-9ef7-32798576ad7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:14:59.429480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5203c-a584-4f86-9ef7-32798576ad7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:59.431151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5203c-a584-4f86-9ef7-32798576ad7c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:59.443700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 216/417] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:14:59.451892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:14:59.574187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:14:59.589785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed142-bfa1-45f4-b2a3-da3ece05139c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:14:59.623137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d1f79-80eb-4853-b478-bb4514756b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:14:59.623843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d1f79-80eb-4853-b478-bb4514756b49 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:14:59.624118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d1f79-80eb-4853-b478-bb4514756b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:14:59.624383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d1f79-80eb-4853-b478-bb4514756b49 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/ed8635b4ce034605bcce301f3f98e721/roles/d58da09371854b4ab217716b0492fb82` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:14:59.639219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d1f79-80eb-4853-b478-bb4514756b49 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=ed8635b4ce034605bcce301f3f98e721, role_id=d58da09371854b4ab217716b0492fb82)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:14:59.640750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d1f79-80eb-4853-b478-bb4514756b49 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:14:59.660286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 202/418] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:14:59 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/ed8635b4ce034605bcce301f3f98e721/roles/d58da09371854b4ab217716b0492fb82 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:15:00.504735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81022b6e-3e84-44da-8c99-c4d8f8a2f47c None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:00.505244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81022b6e-3e84-44da-8c99-c4d8f8a2f47c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:00.505244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81022b6e-3e84-44da-8c99-c4d8f8a2f47c None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:00.506775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 217/419] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:00.512143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70fdb9-1f38-4cc4-a26c-4b7a9d9603ed None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:00.512431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70fdb9-1f38-4cc4-a26c-4b7a9d9603ed None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:00.512707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70fdb9-1f38-4cc4-a26c-4b7a9d9603ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:00.544597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fc70fdb9-1f38-4cc4-a26c-4b7a9d9603ed None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:00.545791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fc70fdb9-1f38-4cc4-a26c-4b7a9d9603ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:00.645495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 203/420] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:15:00.994638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10ff7-be62-4324-9d57-4a9854bfc514 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:00.995052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10ff7-be62-4324-9d57-4a9854bfc514 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:00.995246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10ff7-be62-4324-9d57-4a9854bfc514 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:00.996770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 218/421] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:01.002212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a389-e3eb-49a7-a17b-47cf2d12d746 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.002633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a389-e3eb-49a7-a17b-47cf2d12d746 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.002790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a389-e3eb-49a7-a17b-47cf2d12d746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.025236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6b28a389-e3eb-49a7-a17b-47cf2d12d746 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:01.026429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6b28a389-e3eb-49a7-a17b-47cf2d12d746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:01.067159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10ff7-be62-4324-9d57-4a9854bfc514 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:01.070299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:01.125023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:01.145492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 204/422] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:15:01.182569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10ff7-be62-4324-9d57-4a9854bfc514 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:01.220886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38830d-6423-4936-9e7b-be836d40cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:01.221553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38830d-6423-4936-9e7b-be836d40cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.221832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38830d-6423-4936-9e7b-be836d40cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.222103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38830d-6423-4936-9e7b-be836d40cae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.235394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38830d-6423-4936-9e7b-be836d40cae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-2b38830d-6423-4936-9e7b-be836d40cae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:01.240584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:01.241581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:01.242906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 219/423] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:01.248459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28a389-e3eb-49a7-a17b-47cf2d12d746 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:01.355227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01742c-ab0d-419f-a27f-53d610a9977f None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.355523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01742c-ab0d-419f-a27f-53d610a9977f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.355775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01742c-ab0d-419f-a27f-53d610a9977f None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.357350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 220/424] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:01.362232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dfe76-3391-4fd9-bb97-9d2de68aab92 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.362508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dfe76-3391-4fd9-bb97-9d2de68aab92 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.362787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dfe76-3391-4fd9-bb97-9d2de68aab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.373662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28a389-e3eb-49a7-a17b-47cf2d12d746 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:01.391732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7f5dfe76-3391-4fd9-bb97-9d2de68aab92 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:01.392942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7f5dfe76-3391-4fd9-bb97-9d2de68aab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:01.433550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb252ad1-b55c-46e7-8c6e-67e8eaf1942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:01.434169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb252ad1-b55c-46e7-8c6e-67e8eaf1942f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.434443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb252ad1-b55c-46e7-8c6e-67e8eaf1942f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.434997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb252ad1-b55c-46e7-8c6e-67e8eaf1942f None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.436552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb252ad1-b55c-46e7-8c6e-67e8eaf1942f None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:01.436866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb252ad1-b55c-46e7-8c6e-67e8eaf1942f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:01.438489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb252ad1-b55c-46e7-8c6e-67e8eaf1942f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:01.450738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 205/425] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:01.456331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e47a-88b3-4126-9474-75790fa0e481 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.456610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e47a-88b3-4126-9474-75790fa0e481 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.456890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e47a-88b3-4126-9474-75790fa0e481 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.458393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 206/426] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:01.462002 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e47a-88b3-4126-9474-75790fa0e481 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:01.469736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:01.483374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 221/427] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:15:01.485418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43dc0f-026a-46d7-928e-34258a5ddc4b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.485948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43dc0f-026a-46d7-928e-34258a5ddc4b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.486453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43dc0f-026a-46d7-928e-34258a5ddc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.506050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-fa43dc0f-026a-46d7-928e-34258a5ddc4b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:01.508176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fa43dc0f-026a-46d7-928e-34258a5ddc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:01.535789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:01.580942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e47a-88b3-4126-9474-75790fa0e481 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:01.584977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 222/428] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:01.586565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43dc0f-026a-46d7-928e-34258a5ddc4b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:01.616348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:01.617082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.617430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.617653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.628886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:01.630336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:01.645585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:01.646580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:01.651800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:01.651800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:01.651800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:01.651800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 207/429] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:01.664498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:01.702507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43dc0f-026a-46d7-928e-34258a5ddc4b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:01.727137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:01.738965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:01.739982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.740458 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.740932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.752389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:01.758098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:01.758947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:01.759717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:01.762332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 223/430] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:01.767760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:01.835253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524435-735f-49cb-b4b1-3a3d88dce6c8 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:01.845014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:01.877588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:01.878543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.879063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.879550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.880414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:01.880909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:01.883062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:01.904945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 208/431] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:01.904945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:01.918104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d5051-b210-4890-a71e-bfe383a60c00 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:01.958391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:01.959049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:01.959336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:01.959605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:01.960271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:01.960572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:01.962180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:01.971548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 224/432] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:01.972369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.012250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6b4c1-8e1b-4150-841d-ebf089bbeb35 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.017118 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.047848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.048483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.048762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.049034 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.061711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:02.067965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:02.068836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:02.069596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 209/433] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:02.070458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.077651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f6e70-6431-4ad6-924f-8f5ee0924c49 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.099613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.114751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.115409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.115679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.115942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.123714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.125147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:02.136254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:02.137145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:02.138027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 225/434] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Oct 11 13:15:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:02.138560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.187347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a669b-488e-4a65-87d8-705e8b7638ad None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.224094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.224722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.224994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.225256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.235547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:02.240332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:02.241200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:02.242030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 210/435] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:02.242778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.251422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867cc3a-2ba8-4147-bca5-74730f85fe30 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.254956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.287912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.288912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.289178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.289435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.304770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.307356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:02.329398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:02.330352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:02.331239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:02.331239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:02.331239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:02.339010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 226/436] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:02.339621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.340649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.356495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c1420-6c05-4e89-ba38-f0380ac6dba6 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.392402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.393370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.393846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.394599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.395502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:02.396000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.397562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.406251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 211/437] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:02.407438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.454657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054d382-16c3-4e28-9171-8948f1851f2e None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.487978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.488685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.489026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.489359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.490148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:02.490456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.492010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.509124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 227/438] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:02.509954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.521529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f13ca-9371-4582-a391-366be195b3a2 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.525335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.555637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.556180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.556516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.556800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.557513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:02.557821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.559230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.567068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 212/439] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:02.567860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.584017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.609311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af0fc-95a2-4ccf-b3de-2c17352e663e None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.642739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549a12f-d7e2-42af-8d6c-eaf6cfd42cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.643370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549a12f-d7e2-42af-8d6c-eaf6cfd42cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.643646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549a12f-d7e2-42af-8d6c-eaf6cfd42cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.643913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549a12f-d7e2-42af-8d6c-eaf6cfd42cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.644551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549a12f-d7e2-42af-8d6c-eaf6cfd42cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:02.644860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549a12f-d7e2-42af-8d6c-eaf6cfd42cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.646219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549a12f-d7e2-42af-8d6c-eaf6cfd42cb8 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.657405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 228/440] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:02.658557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b93e2-c002-40ac-933c-255677925900 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.658806 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b93e2-c002-40ac-933c-255677925900 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.659130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b93e2-c002-40ac-933c-255677925900 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.660399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 229/441] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:02.660997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b93e2-c002-40ac-933c-255677925900 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.673260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb2ea2-6227-44bb-bfc2-4897300d3154 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.706829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.707485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.707764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.708039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.718789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.720274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:02.734997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:02.735934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:02.736741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:02.736741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:02.736741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:02.736958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.737027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 213/442] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:02.737961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.762300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b93e2-c002-40ac-933c-255677925900 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.797221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dfd8c-1b1e-4a3a-ae63-11779a605663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.797802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dfd8c-1b1e-4a3a-ae63-11779a605663 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.798084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dfd8c-1b1e-4a3a-ae63-11779a605663 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.798354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dfd8c-1b1e-4a3a-ae63-11779a605663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.798481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.839220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65425490-1a0f-4f70-afde-9d101d4ea388 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:02.869112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dfd8c-1b1e-4a3a-ae63-11779a605663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.870566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dfd8c-1b1e-4a3a-ae63-11779a605663 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.871328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:02.871956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.872233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.872501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.884435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:02.885879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:02.900244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:02.901321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:02.902161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:02.902161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:02.902161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:02.902161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 214/443] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:02.902404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:02.942070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:02.967825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 230/444] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:15:02.969010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f71d8-59ef-4f4f-adc9-177a2e916fc7 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:02.969291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f71d8-59ef-4f4f-adc9-177a2e916fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:02.969557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f71d8-59ef-4f4f-adc9-177a2e916fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:02.987929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ce3f71d8-59ef-4f4f-adc9-177a2e916fc7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:02.989105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ce3f71d8-59ef-4f4f-adc9-177a2e916fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:03.002625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b039c-1b85-49cb-8d03-9e700ab8f4fe None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.018844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.036234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.036862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.037138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.037409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.045300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.046740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.056667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 231/445] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:03.059148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:03.060008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:03.060961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:03.061443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f71d8-59ef-4f4f-adc9-177a2e916fc7 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.063643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 215/446] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:03.063991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.161615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f71d8-59ef-4f4f-adc9-177a2e916fc7 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.165126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.175243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a01262-4115-4f52-a250-350d686e73cb None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.200630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.201244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.201525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.201793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.202716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:03.203052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.204449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.211165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.211849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.212126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.212392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.213169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:03.213445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.214803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.216032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 232/447] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:03.221076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.231122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 216/448] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:03.232657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.268116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.330235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc408e1-6052-4f67-b341-ff532963b6ac None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.331478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278be5-eda8-4f23-8e8f-f567b3630374 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.364256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.364882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.365152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.365414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.367955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.368558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.368832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.369100 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.369824 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:03.370129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.371584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.375717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.377156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.388545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 217/449] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:03.389334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:03.391664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:03.392535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:03.393396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:03.393396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:03.393396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:03.393396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 233/450] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:03.394015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.413978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.485499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.492920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54e93-ac29-4dfd-bc7f-7cbfb29854df None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.495179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bfca3-27ec-49e0-8c3d-4785e19a26ea None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.527243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.527880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.528083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.528525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.528525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.528725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.529002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.529271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.535562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.536905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.537001 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.538329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:03.549809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:03.550721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 13:15:03.551601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:03.552094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:03.552870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 11 13:15:03.553727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:03.554211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 218/451] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:03.554211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.555737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 234/452] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:03.556752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.632094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.655840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17d727-5bce-4b63-b5cb-eb16c497d3cb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.656881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f221-5615-480a-934e-546bbcbc3895 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.690111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.690384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.690667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.690967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.691058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.691234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.691321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.691557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.701141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:03.702251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.703730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:03.706298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:03.707359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 219/453] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:03.713479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:03.718189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:03.719067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:03.720532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:03.720532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:03.720532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:03.720532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 235/454] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:03.720532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.726773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.810742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc97a9-69a9-49ac-a211-3c0a24063d61 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.819058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a08e01-5b0c-4211-af52-14b0914cfea5 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.842609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.843250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.843461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.843561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.843780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.844772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:03.845074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.846453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.851926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.852522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.852794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.853059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.853767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:03.854064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.855512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:03.858294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 220/455] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:03.859113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.872839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 236/456] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:03.872839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:03.937032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:03.961623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec410f-d5ec-4523-84b8-414bfffb94c9 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.975956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc1268-020d-4428-89f7-230affe810ab None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:03.996296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:03.996865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:03.997138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:03.997403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:03.998117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:03.998414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:03.999868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.011192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.011795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.012073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.012324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.012977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:04.013261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.014632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.016783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 221/457] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:04.017570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.022523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 237/458] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:04.023439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.070963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.121586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5080-de05-41f3-981f-f603695bb0e3 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.121863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fb704-f9eb-4c1e-93d8-a9bd2269fa32 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.150487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.154853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.155485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.155730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.155831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.156004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.156336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.156616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.156883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.157520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:04.157889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.159309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.162917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.164902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.170834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 222/459] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:04.171634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:04.176659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:04.177486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:04.178302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 238/460] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:04.178762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.270703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87d827-6124-422b-9421-4e631ceda7de None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.277359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084352-ab48-4635-888d-d95463bd2c44 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.285900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.304053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.304670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.304933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.305202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.311530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.312129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.312407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.312676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.363728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.373882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.375677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.380114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.381557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.470810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 223/461] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:15:04.471703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.480592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 239/462] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:15:04.481783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.494046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.560225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.568807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a95091-1353-4c83-9a9c-f8a3972e84f8 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.583389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6adae7-7f2d-4e41-8d2f-1cef2cd73ff7 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.601581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.602208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.602482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.602750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.613270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.614682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.616957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.617637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.617919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.618182 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.624781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.626232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:04.629612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:04.630518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:04.631371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:04.631371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:04.631371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:04.631371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 224/463] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:04.631586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:04.638738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:04.639590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:04.640398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 240/464] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:04.640948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.709049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.732114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a692-156f-4f1e-9de5-f423babd64da None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.746388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f99307-0490-4fb0-96f5-f0bf4281977a None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.765097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.765703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.765957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.766220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.766936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:04.767238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.768672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.778920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.779554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.779828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.780097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.780260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 225/465] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:04.781055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.785580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.791864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.793324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:04.807540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:04.808463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:04.809273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:04.809273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:04.809273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:04.809273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 241/466] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:04.809479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.880607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8079-539d-42ab-945a-e39bf22e6b36 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.905564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acafa6-ffc5-47e8-a13a-36409ff7d072 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:04.914175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.914809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.915180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.915448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.925162 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:04.926435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.928044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.940355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:04.940959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:04.941241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:04.941509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:04.942139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:04.942436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:04.943146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:04.944006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:04.944851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:04.944851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:04.944851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:04.945047 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:04.945114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 226/467] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:04.945271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:04.959389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 242/468] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:04.960282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.009626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.053613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918cb4-720c-4894-bcb9-0f84b6e0217d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.056710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faf2a2-1305-40d9-bade-b1409742729b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.086304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.086947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.087243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.087500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.088187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:05.088493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.088879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.089478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.089755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.089913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.090025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.090740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] RBAC: Adding query filter params (role.id=d58da09371854b4ab217716b0492fb82, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=c81304f420a447a1a488a941d4075513) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:05.091072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.092495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.098100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 243/469] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/role_assignments?user.id=c81304f420a447a1a488a941d4075513&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=d58da09371854b4ab217716b0492fb82 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:05.098895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.101703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 227/470] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:05.102539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.160311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.221468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379fef-9580-486d-8331-98e8bae905cb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.223000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f470a2-ade1-4c71-810a-d0c1d4587efe None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.242931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.260696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.261446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.261793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.262070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.262279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.262721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:05.262912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.263062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.263207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.263448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.264087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:05.264383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.264486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.265730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.278478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 244/471] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:05.283829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 228/472] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:05.283948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.284020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.395729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf4901-2f86-4525-a220-589e79954cca None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.398917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.399841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f33ab-e958-4e10-91ee-05fd4041fc00 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.433066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.433636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.433911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.434179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/49febc522c0845be9c92b13169bdbc68/roles/d58da09371854b4ab217716b0492fb82` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.434521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.435192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.435471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.435743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.444080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.445736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.449660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=49febc522c0845be9c92b13169bdbc68, role_id=d58da09371854b4ab217716b0492fb82)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.451107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:05.457899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:05.458860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:05.459762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 245/473] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:05.460288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.468261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 229/474] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:15:05 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/49febc522c0845be9c92b13169bdbc68/roles/d58da09371854b4ab217716b0492fb82 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:15:05.469093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.507239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.577735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e2eca-0605-4f6d-b6eb-ddb9d7d4eabd None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.583869 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210414-52a2-4ac9-b6f9-f03df1c72d61 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.617407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.618134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.618475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.618810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.622554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.623324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.623670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.624045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.627422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.629215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.631922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.633790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:05.642032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:05.643092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:05.643965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 246/475] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:05.644472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:05.656657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:05.658301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 230/476] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:05.660047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.672873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.756132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.772607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96607a1-5100-43e1-8137-99c5b5a197cb None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.774812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd443-31c8-4504-84e4-e41a9d93a22d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.812356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.813171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.813698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.813883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.814667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:05.815110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.816864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.823009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.823863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.824280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.824730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.826257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:05.826715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:05.829098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:05.836266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 231/477] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:05.837308 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.850505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 247/478] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:05.855729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:05.938720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:05.958398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a8bd2-db8b-43c6-bf29-41f69f1ba804 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.965663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaeac0-336c-4333-be1b-d32efceb17a9 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:05.997307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:05.997915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:05.998190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:05.998457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:05.999208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] RBAC: Adding query filter params (role.id=d58da09371854b4ab217716b0492fb82, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=e466d119406f489b962596b7cd9fb7e5) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:05.999513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:06.000947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:06.010963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 248/479] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/role_assignments?user.id=e466d119406f489b962596b7cd9fb7e5&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=d58da09371854b4ab217716b0492fb82 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:06.010963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:06.023412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:06.024238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:06.024516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:06.024783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:06.027572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:06.027888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:06.031874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:06.063626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 232/480] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:06.069776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:06.081457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:06.202170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527323c-fa97-42eb-b024-73839d4f14de None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:06.232895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309393-5790-4f87-b803-97aa1dbf3ad0 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:06.241190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:06.242844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:06.243315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:06.243769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:06.244687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] RBAC: Adding query filter params (role.id=d58da09371854b4ab217716b0492fb82, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=1a06e2819ffa4bbcaaf07f8b962c531c) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:06.245179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:06.246858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:06.254127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 233/481] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:06 2022] GET /identity/v3/role_assignments?user.id=1a06e2819ffa4bbcaaf07f8b962c531c&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=d58da09371854b4ab217716b0492fb82 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:06.291906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:06.292919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:06.293397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:06.293930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:06.312659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:06.386902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:06.388451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:06.498079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 249/482] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:15:06.503736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:06.578811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:06.609938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70747f68-8c12-4c77-ad3e-3fdcb280e36c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:06.645732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:06.646371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:06.646645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:06.647043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:06.658006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:06.659491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:06.674276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:06.675299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:06.676114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:06.676114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:06.676114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:06.676114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 234/483] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:06.683918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:06.733791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:06.790469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cfeb-82aa-41d5-b156-897d1b35a590 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:06.832321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:06.832866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:06.833146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:06.833411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:06.834054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:06.834355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:06.835879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:06.848414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 250/484] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:06.853748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:06.990595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441f12-df44-45ab-957a-034b46adc93d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:07.025487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:07.040783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:07.041417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:07.041688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:07.041954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:07.055863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:07.057312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:07.072130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:07.073065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:07.073861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 235/485] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:07.079229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:07.237567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a22d42-78dc-440f-9d7f-d02266bd2b45 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:07.248820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:07.292910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0d128-fe2a-4596-a27a-5e0c34d4e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:07.293531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0d128-fe2a-4596-a27a-5e0c34d4e5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:07.293806 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0d128-fe2a-4596-a27a-5e0c34d4e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:07.294070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0d128-fe2a-4596-a27a-5e0c34d4e5d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:07.294765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0d128-fe2a-4596-a27a-5e0c34d4e5d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:07.295094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0d128-fe2a-4596-a27a-5e0c34d4e5d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:07.296526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0d128-fe2a-4596-a27a-5e0c34d4e5d0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:07.320205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 251/486] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:07.325798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:07.484673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788566c-a25f-457a-bf78-4abb6afa5bc0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:07.518071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95ba3-f4ef-427a-9f5e-15f1f8a27615 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:07.518366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95ba3-f4ef-427a-9f5e-15f1f8a27615 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:07.518543 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95ba3-f4ef-427a-9f5e-15f1f8a27615 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:07.520156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 252/487] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:07.528056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080774-a0ff-4b2c-ab1b-9eb998c55040 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:07.528332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080774-a0ff-4b2c-ab1b-9eb998c55040 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:07.528607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080774-a0ff-4b2c-ab1b-9eb998c55040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:07.530284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884a613-1af5-4efc-a215-c0c14755e80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:07.531137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a613-1af5-4efc-a215-c0c14755e80b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:07.531627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a613-1af5-4efc-a215-c0c14755e80b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:07.532085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a613-1af5-4efc-a215-c0c14755e80b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:07.533001 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884a613-1af5-4efc-a215-c0c14755e80b None admin] RBAC: Adding query filter params (role.id=d58da09371854b4ab217716b0492fb82, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=ed8635b4ce034605bcce301f3f98e721) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:07.533500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884a613-1af5-4efc-a215-c0c14755e80b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:07.535137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884a613-1af5-4efc-a215-c0c14755e80b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:07.544645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 236/488] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:07 2022] GET /identity/v3/role_assignments?user.id=ed8635b4ce034605bcce301f3f98e721&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=d58da09371854b4ab217716b0492fb82 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:07.557619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f7080774-a0ff-4b2c-ab1b-9eb998c55040 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:07.559261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f7080774-a0ff-4b2c-ab1b-9eb998c55040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:07.655318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 253/489] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:15:07.913309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6db7b-0291-4e79-9460-b465f3986ad2 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:07.914014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6db7b-0291-4e79-9460-b465f3986ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:07.914255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6db7b-0291-4e79-9460-b465f3986ad2 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:07.915900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 237/490] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:07.921159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81f73-9264-4fef-a32b-4fd1532db4c7 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:07.921587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81f73-9264-4fef-a32b-4fd1532db4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:07.921681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81f73-9264-4fef-a32b-4fd1532db4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:07.942566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-68e81f73-9264-4fef-a32b-4fd1532db4c7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:07.943762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-68e81f73-9264-4fef-a32b-4fd1532db4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:07.959707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6db7b-0291-4e79-9460-b465f3986ad2 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.031724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:08.058624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 254/491] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:08.088655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6db7b-0291-4e79-9460-b465f3986ad2 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:08.122545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:08.123211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.123482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.123748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.134543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:08.139795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:08.140655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:08.141439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 238/492] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:08.151953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e81f73-9264-4fef-a32b-4fd1532db4c7 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.198805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:08.303622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e81f73-9264-4fef-a32b-4fd1532db4c7 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:08.353817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:08.354445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.354723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.355018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.355688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:08.355991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:08.357374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:08.371177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 255/493] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:08.376503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.398197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.513192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:08.526062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a8c86-7030-44f4-b15c-f9ae8052cbd0 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:08.565982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:08.566655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.566965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.567244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.580737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:08.586172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:08.587823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:08.589029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 256/494] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:08.593789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.633036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6b5a-a35a-487b-90cd-47780e63026f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:08.646159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:08.701291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a2c0-fbca-4674-ad6f-649cc0891ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:08.701932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a2c0-fbca-4674-ad6f-649cc0891ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.702208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a2c0-fbca-4674-ad6f-649cc0891ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.702474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a2c0-fbca-4674-ad6f-649cc0891ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.715981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a2c0-fbca-4674-ad6f-649cc0891ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:08.717425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a2c0-fbca-4674-ad6f-649cc0891ff8 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-ddb9a2c0-fbca-4674-ad6f-649cc0891ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:08.733847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:08.734793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:08.735680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:08.735680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:08.735680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:08.735680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 239/495] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:08.738849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270bfec-eae1-424c-b1a8-186c7c6a771f None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.738849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270bfec-eae1-424c-b1a8-186c7c6a771f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.738849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270bfec-eae1-424c-b1a8-186c7c6a771f None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.739173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579de75-1ce1-4314-bd9a-50443764c980 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:08.742728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 240/496] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:08.744449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270bfec-eae1-424c-b1a8-186c7c6a771f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.782776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa92bf-2c52-464d-8fa2-2c61e7cabe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:08.783333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa92bf-2c52-464d-8fa2-2c61e7cabe41 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.783605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa92bf-2c52-464d-8fa2-2c61e7cabe41 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.783905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa92bf-2c52-464d-8fa2-2c61e7cabe41 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.784774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa92bf-2c52-464d-8fa2-2c61e7cabe41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:08.785109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa92bf-2c52-464d-8fa2-2c61e7cabe41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:08.787464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa92bf-2c52-464d-8fa2-2c61e7cabe41 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:08.798184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 257/497] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:08.800111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482866-0d8a-4098-a3d1-cd5d3e4f9e01 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.800395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482866-0d8a-4098-a3d1-cd5d3e4f9e01 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.800918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482866-0d8a-4098-a3d1-cd5d3e4f9e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.824012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2e482866-0d8a-4098-a3d1-cd5d3e4f9e01 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:08.825477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2e482866-0d8a-4098-a3d1-cd5d3e4f9e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:08.829601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:08.868382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270bfec-eae1-424c-b1a8-186c7c6a771f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:08.902753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:08.903419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:08.903691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:08.903961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:08.904653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:08.904949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:08.906484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:08.918466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 258/498] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:08.919670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482866-0d8a-4098-a3d1-cd5d3e4f9e01 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.926982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 241/499] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:08.932250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:08.967429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:09.030260 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482866-0d8a-4098-a3d1-cd5d3e4f9e01 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.069501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.070552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.071010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.071431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.081009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:09.084489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.086309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:09.104430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:09.105566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:09.106581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:09.106581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:09.106581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:09.108811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 259/500] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:09.114153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.147507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fa3f7-9d78-48a4-ab33-dd7b9fff927c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.219515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.226859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.226859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.226859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.228948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.230463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:09.246870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:09.247886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:09.249320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 242/501] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Oct 11 13:15:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:09.251691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.355008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:09.370401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad13a-7937-4860-9899-3ee92a61e8e5 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.377253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3bda9-5005-4f19-8ed1-55d1f256f3a0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.405987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670640c1-4600-4f90-b6bb-aa7e7151888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.406884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670640c1-4600-4f90-b6bb-aa7e7151888a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.407561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670640c1-4600-4f90-b6bb-aa7e7151888a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.407743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670640c1-4600-4f90-b6bb-aa7e7151888a None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.408512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670640c1-4600-4f90-b6bb-aa7e7151888a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:09.408924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670640c1-4600-4f90-b6bb-aa7e7151888a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.410393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670640c1-4600-4f90-b6bb-aa7e7151888a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.413065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.414058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.414335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.414605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.415366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:09.415668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.417132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.425121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 260/502] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:09.427073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813d7dd-234c-4deb-8a90-d34aa12468f9 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.427582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813d7dd-234c-4deb-8a90-d34aa12468f9 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.428048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813d7dd-234c-4deb-8a90-d34aa12468f9 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.433669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 261/503] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:09.433669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813d7dd-234c-4deb-8a90-d34aa12468f9 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.440510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 243/504] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:09.440510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.497302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:09.537392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e897b4-9974-4ba2-a144-25e4691686ca None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.568924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813d7dd-234c-4deb-8a90-d34aa12468f9 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.576643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53401656-6be0-4537-acc0-e0a4c6b6812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.577440 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401656-6be0-4537-acc0-e0a4c6b6812e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.577824 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401656-6be0-4537-acc0-e0a4c6b6812e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.578200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401656-6be0-4537-acc0-e0a4c6b6812e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.582586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:09.588556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53401656-6be0-4537-acc0-e0a4c6b6812e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.590357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53401656-6be0-4537-acc0-e0a4c6b6812e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-53401656-6be0-4537-acc0-e0a4c6b6812e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:09.604155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:09.605322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:09.606480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:09.612397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 244/505] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:09.612397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00991-b0de-48cd-b32b-569df88ba001 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.612397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00991-b0de-48cd-b32b-569df88ba001 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.612397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00991-b0de-48cd-b32b-569df88ba001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.628326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.629494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.629860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.630221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.630364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-c0a00991-b0de-48cd-b32b-569df88ba001 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:09.631303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.631805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c0a00991-b0de-48cd-b32b-569df88ba001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:09.632968 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:09.647497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:09.648629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:09.649461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:09.650208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 262/506] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:09.654434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.711012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 245/507] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:09.712320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00991-b0de-48cd-b32b-569df88ba001 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.764272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed24e-d6de-4917-b76d-072159f15d21 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.787228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:09.814389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.815433 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.815929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.816886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.828687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00991-b0de-48cd-b32b-569df88ba001 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:09.832681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.834373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:09.854930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:09.855866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:09.857330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:09.857330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:09.857330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:09.857330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 263/508] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:09.857330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.859812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:09.872749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f6913-0349-4841-a379-3214098b671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:09.874298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6913-0349-4841-a379-3214098b671f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:09.874853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6913-0349-4841-a379-3214098b671f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:09.875356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6913-0349-4841-a379-3214098b671f None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:09.876522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f6913-0349-4841-a379-3214098b671f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:09.877371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f6913-0349-4841-a379-3214098b671f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:09.879002 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f6913-0349-4841-a379-3214098b671f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:09.903267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 246/509] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:09.904393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f6913-0349-4841-a379-3214098b671f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:09.978060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cbd3-e02b-4ccc-b518-f28e3816188a None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.013889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f6913-0349-4841-a379-3214098b671f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.016682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.017290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.017562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.017827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.018435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:10.018730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.020141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.029887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 264/510] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:10.030651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.055589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.056497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.056773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.057040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.057699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:10.057991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.059497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.065368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.073075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 247/511] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:10.073945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.122144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.140476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b188-dc15-4590-8806-6f42bbdff63c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.173975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.174603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.174910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.175200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.180458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3269-aafe-485a-a491-e40a704b2b18 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.212878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.213502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.213776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.214046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.224352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.225786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.238618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:10.239628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:10.240598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:10.241476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:10.241476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:10.241476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:10.241640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.241730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 248/512] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:10.241730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.272120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.337541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.340283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 265/513] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 13:15:10.341133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.347728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad352-eb0f-4988-a607-1e3de7727683 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.380029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec416dd-24da-4f84-a0eb-2516c6c077e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.380648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec416dd-24da-4f84-a0eb-2516c6c077e8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.380798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec416dd-24da-4f84-a0eb-2516c6c077e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.381059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec416dd-24da-4f84-a0eb-2516c6c077e8 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.381676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec416dd-24da-4f84-a0eb-2516c6c077e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:10.381966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec416dd-24da-4f84-a0eb-2516c6c077e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.383434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec416dd-24da-4f84-a0eb-2516c6c077e8 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.388922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 249/514] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:10.390117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b482bb-ca7a-465b-8ae2-a9cf90ca9b5a None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.390395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b482bb-ca7a-465b-8ae2-a9cf90ca9b5a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.390659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b482bb-ca7a-465b-8ae2-a9cf90ca9b5a None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.392272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 250/515] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:10.393016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b482bb-ca7a-465b-8ae2-a9cf90ca9b5a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.449473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc488d7-7b02-466d-a2d6-d89f5ac01a0b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.482593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.489117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.489767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.490041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.490310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.498196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.499625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:10.511612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:10.512652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 266/516] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:10.513532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.531069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b482bb-ca7a-465b-8ae2-a9cf90ca9b5a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.577094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d2b25-2209-4fac-83d6-70f52d80b53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.577709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d2b25-2209-4fac-83d6-70f52d80b53c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.577977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d2b25-2209-4fac-83d6-70f52d80b53c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.578239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d2b25-2209-4fac-83d6-70f52d80b53c None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.579065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d2b25-2209-4fac-83d6-70f52d80b53c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:10.579359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d2b25-2209-4fac-83d6-70f52d80b53c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.581291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d2b25-2209-4fac-83d6-70f52d80b53c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.596095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 251/517] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:10.597512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baae1f0-55b5-4188-8e45-569787329f69 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.597512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baae1f0-55b5-4188-8e45-569787329f69 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.597784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baae1f0-55b5-4188-8e45-569787329f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.618217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1baae1f0-55b5-4188-8e45-569787329f69 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:10.619697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1baae1f0-55b5-4188-8e45-569787329f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:10.627722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4769a-405b-4d3e-839b-3abebcd1a1f0 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.634709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.662435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.663084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.663355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.664078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.675013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.676885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.696465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 252/518] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:10.696648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:10.697894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:10.698975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:10.698975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:10.698975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:10.699201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baae1f0-55b5-4188-8e45-569787329f69 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.699282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 267/519] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:10.699282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.766248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.818027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baae1f0-55b5-4188-8e45-569787329f69 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.838974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588aa02-3ae1-41d0-ade2-b803596ae2d3 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:10.856825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.857804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.858278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.859178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.859912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:10.860219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.861644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.874181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 253/520] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:10.875105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:10.882177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:10.882870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:10.883472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:10.883745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:10.884387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:10.885869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:10.894316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:10.914844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 268/521] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:15:10 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:10.914844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:11.031935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b25714-d6c2-4f70-867f-bb28f4badef5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.044767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:11.048814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ed839-5452-423b-ae7b-176ab5ad52a8 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.074035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.074667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.074976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.075242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.075886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:11.076182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.077614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.093414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.093886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 254/522] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:11.094840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:11.098874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.099158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.100368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/c81304f420a447a1a488a941d4075513/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.102600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=c81304f420a447a1a488a941d4075513, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.104127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.122156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 269/523] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:15:10 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/c81304f420a447a1a488a941d4075513/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:15:11.123320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:11.186934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:11.236799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598ecd8-b13f-4eb1-b563-0c6524f87fe0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.241515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860bd0-4685-473a-b48f-b818b0188d9c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.286922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.286922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.286922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.286922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.293556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.294217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.294507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.294746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.295304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.295426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.296738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.296845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:11.308466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:11.309490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:11.310300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 255/524] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:11 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:11.312219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:11.313005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:11.313845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 270/525] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:11.319394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:11.322494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:11.354307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:11.447486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28213d-422c-4687-b6e7-b8100f8dff53 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.454251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8493-1d9c-4409-b083-2b5d0678f0f0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.490635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.491296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.491521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.491669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.491953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.492552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:11.492855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.493152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.493642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.494090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.494401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.495178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:11.495767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:11.496255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.499291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.500651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 256/526] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:11.506023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:11.519305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 271/527] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:11.523516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:11.637117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:11.661775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002df5b-9fbe-499b-85f0-814d654ae3fd None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.702642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70514d7e-1aea-465b-a599-6856832ff009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.703729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70514d7e-1aea-465b-a599-6856832ff009 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.704430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70514d7e-1aea-465b-a599-6856832ff009 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.704892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70514d7e-1aea-465b-a599-6856832ff009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.705799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70514d7e-1aea-465b-a599-6856832ff009 None admin] RBAC: Adding query filter params (role.id=d58da09371854b4ab217716b0492fb82, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=49febc522c0845be9c92b13169bdbc68) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:11.706291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70514d7e-1aea-465b-a599-6856832ff009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.708762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70514d7e-1aea-465b-a599-6856832ff009 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.719156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 272/528] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:11 2022] GET /identity/v3/role_assignments?user.id=49febc522c0845be9c92b13169bdbc68&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=d58da09371854b4ab217716b0492fb82 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:11.729183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1cfa2-06a5-4f15-bef8-3e81cf52d6f1 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:11.770297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f65017-bc84-4591-88a4-5c6f90949263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:11.770966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f65017-bc84-4591-88a4-5c6f90949263 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:11.771245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f65017-bc84-4591-88a4-5c6f90949263 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:11.771521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f65017-bc84-4591-88a4-5c6f90949263 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:11.772164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f65017-bc84-4591-88a4-5c6f90949263 None admin] RBAC: Adding query filter params (type=network) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:11.772465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f65017-bc84-4591-88a4-5c6f90949263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:11.773900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f65017-bc84-4591-88a4-5c6f90949263 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:11.779620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 257/529] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:12.732904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1528353-18ef-4865-9294-6487b01153b7 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:12.733450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1528353-18ef-4865-9294-6487b01153b7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:12.733450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1528353-18ef-4865-9294-6487b01153b7 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:12.735053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 273/530] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:12.740686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cc1b-e51e-4674-90bd-e2a52a955fb0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:12.741114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cc1b-e51e-4674-90bd-e2a52a955fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:12.741288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cc1b-e51e-4674-90bd-e2a52a955fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:12.763840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e1d7cc1b-e51e-4674-90bd-e2a52a955fb0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:12.765037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e1d7cc1b-e51e-4674-90bd-e2a52a955fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:12.832073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:12.844613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 258/531] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:13.161739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1528353-18ef-4865-9294-6487b01153b7 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:13.291660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1528353-18ef-4865-9294-6487b01153b7 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:13.346170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f35c-9e68-44fb-b976-696667e02d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:13.346783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f35c-9e68-44fb-b976-696667e02d2d None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:13.347088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f35c-9e68-44fb-b976-696667e02d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:13.347354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f35c-9e68-44fb-b976-696667e02d2d None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:13.348019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f35c-9e68-44fb-b976-696667e02d2d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:13.349403 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f35c-9e68-44fb-b976-696667e02d2d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:13.380628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 274/532] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:13 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:13.837874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e150cb-bb95-4f7f-a8d4-d41e7186b10b None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:13.838396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e150cb-bb95-4f7f-a8d4-d41e7186b10b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:13.838396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e150cb-bb95-4f7f-a8d4-d41e7186b10b None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:13.840062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 259/533] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:13.845317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8616fc1-289f-413f-aa56-6966b2263a9a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:13.845738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8616fc1-289f-413f-aa56-6966b2263a9a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:13.845922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8616fc1-289f-413f-aa56-6966b2263a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:13.854495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:13.866149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d8616fc1-289f-413f-aa56-6966b2263a9a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:13.867669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d8616fc1-289f-413f-aa56-6966b2263a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:13.911454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6783f4-c11f-45a7-bc17-8ec1a03448a7 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:13.911866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6783f4-c11f-45a7-bc17-8ec1a03448a7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:13.912224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6783f4-c11f-45a7-bc17-8ec1a03448a7 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:13.914220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 260/534] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:13.920114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611063-278e-4c96-a978-c1576a2320b0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:13.920398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611063-278e-4c96-a978-c1576a2320b0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:13.920941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611063-278e-4c96-a978-c1576a2320b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:13.948903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-29611063-278e-4c96-a978-c1576a2320b0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:13.950241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-29611063-278e-4c96-a978-c1576a2320b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:13.953679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 275/535] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:14.054835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 261/536] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:14.222283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8616fc1-289f-413f-aa56-6966b2263a9a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:14.327531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8616fc1-289f-413f-aa56-6966b2263a9a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:14.349893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdbc71-9134-4751-89ef-0f4f91777d95 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.350172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdbc71-9134-4751-89ef-0f4f91777d95 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.350760 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdbc71-9134-4751-89ef-0f4f91777d95 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.352631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 262/537] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:14.364289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ad945-f4eb-4a2f-b445-8f11c11851d0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.364826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ad945-f4eb-4a2f-b445-8f11c11851d0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.365312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ad945-f4eb-4a2f-b445-8f11c11851d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.375171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:14.387131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:14.387783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.388061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.388329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.399853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3c8ad945-f4eb-4a2f-b445-8f11c11851d0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:14.401052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3c8ad945-f4eb-4a2f-b445-8f11c11851d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:14.413062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:14.418393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:14.419332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:14.420161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:14.423970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 276/538] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:14.428524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:14.521593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 263/539] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 13:15:14.522861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ad945-f4eb-4a2f-b445-8f11c11851d0 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:14.583259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:14.592808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1bf1-da6a-4895-8615-546c6a198161 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:14.652126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ad945-f4eb-4a2f-b445-8f11c11851d0 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:14.661728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a8b7b-928c-47f8-9b6c-7e91acd660d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:14.663076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a8b7b-928c-47f8-9b6c-7e91acd660d4 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.663964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a8b7b-928c-47f8-9b6c-7e91acd660d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.664964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a8b7b-928c-47f8-9b6c-7e91acd660d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.666097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a8b7b-928c-47f8-9b6c-7e91acd660d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:14.666605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a8b7b-928c-47f8-9b6c-7e91acd660d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:14.669170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a8b7b-928c-47f8-9b6c-7e91acd660d4 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:14.681039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 277/540] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:14.683109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dee49b-c433-4be4-a74f-0b363f443a8f None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.683998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dee49b-c433-4be4-a74f-0b363f443a8f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.684712 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dee49b-c433-4be4-a74f-0b363f443a8f None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.686764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 278/541] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:14.688188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dee49b-c433-4be4-a74f-0b363f443a8f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:14.696774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8064f67-1265-4e60-acf6-d97e53a044dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:14.697436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8064f67-1265-4e60-acf6-d97e53a044dd None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.697710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8064f67-1265-4e60-acf6-d97e53a044dd None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.697979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8064f67-1265-4e60-acf6-d97e53a044dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.710449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8064f67-1265-4e60-acf6-d97e53a044dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-f8064f67-1265-4e60-acf6-d97e53a044dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:14.716075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:14.717168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:14.718195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:14.720357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 264/542] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:14.721759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6b790-3168-430e-9b83-5bb6786ee705 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.722181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6b790-3168-430e-9b83-5bb6786ee705 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.722644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6b790-3168-430e-9b83-5bb6786ee705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.744184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-43e6b790-3168-430e-9b83-5bb6786ee705 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:14.745813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-43e6b790-3168-430e-9b83-5bb6786ee705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:14.747853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:14.807165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dee49b-c433-4be4-a74f-0b363f443a8f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:14.825864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 265/543] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 13:15:14.826714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6b790-3168-430e-9b83-5bb6786ee705 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:14.854403 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:14.855571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.856001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.856439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.867337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:14.868990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:14.875821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:14.885915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:14.886841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:14.887698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:14.887698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:14.887698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:14.894242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 279/544] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:14.895326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:14.947146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6b790-3168-430e-9b83-5bb6786ee705 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:14.991221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:14.991947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:14.992225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:14.992495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:14.993159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:14.993695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:14.995639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.007054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 266/545] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:15.007190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe8e17-f246-4264-92c8-cd85d8f49f9f None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.008370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.010046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.050655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.051330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.051607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.051878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.052531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.053937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.083265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 280/546] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:14 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:15.084225 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.127287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd191854-d637-4bc9-b5cf-ac793ef61ff0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.130213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.179518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.180304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.180672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.181041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.181790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:15.182231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.183765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.201954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 267/547] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:15.203117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.214279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8e67-bdbd-4de2-bc39-66a46071985f None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.254302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.255357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.255778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.256192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.269105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.270631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:15.285995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:15.287169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:15.288071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:15.288071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:15.288071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:15.288071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 281/548] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:15.289112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.315080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.330261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edf469-8c5a-49c5-a01d-b44efde90edf None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.371929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.372985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.373481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.374491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.388135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:15.393881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:15.394833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:15.395678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:15.398587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 268/549] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:15.399732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.422373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277126ab-bc97-4927-a3a1-6039e0647875 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.427365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.457141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.457772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.458068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.458319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.466263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.467798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:15.479452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:15.480492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:15.481423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:15.485322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 282/550] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:15.486215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.527218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52db5a-d11f-49c8-861e-a7fa63d284c5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.567526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.570847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.571481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.571752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.572110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.572653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:15.572998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.574327 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.590980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 269/551] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:15.592176 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.603684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af5b8d-f751-449a-a70a-861d2c79baf2 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.644812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.645829 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.646305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.646788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.647975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:15.648545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.650133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.660032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 283/552] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:15.661149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.693216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.716703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbba24-df50-4ae4-adff-05e288874154 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.755101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.755709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.755980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.756245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.757011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:15.757291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.759050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.782973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 270/553] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:15.784154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.789269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084df6-50e0-476c-8eff-1f80b810ce60 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.833136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.833817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.834109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.834374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.844236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.846015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.848172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:15.861510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:15.862988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:15.863916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:15.866962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 284/554] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:15.868496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:15.919008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc104a-b36a-4572-9212-63c79bbd03b7 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.959467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:15.960130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:15.960468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:15.960736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:15.969109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:15.973518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:15.975143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:15.993082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609c33-8f3c-4fa6-b658-1881d1408003 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:15.993276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:15.994144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:15.995072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:15.995072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:15.995072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:15.999065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 271/555] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:16.000858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.035049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.035693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.035965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.036228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.048135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.049590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:16.064429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:16.065391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:16.066254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:16.066254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:16.066254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:16.066254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 285/556] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:16.066254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.114842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79d1a-185d-44a7-939c-c2417baaa350 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.122065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:16.153401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0696717-e2ff-4fb2-8b41-33d39ef57d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.154011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0696717-e2ff-4fb2-8b41-33d39ef57d6d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.154289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0696717-e2ff-4fb2-8b41-33d39ef57d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.154558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0696717-e2ff-4fb2-8b41-33d39ef57d6d None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.155302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0696717-e2ff-4fb2-8b41-33d39ef57d6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:16.155606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0696717-e2ff-4fb2-8b41-33d39ef57d6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.157278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0696717-e2ff-4fb2-8b41-33d39ef57d6d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.170896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d2bd0-8f8b-4679-9f15-af0efcc83b2b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.180463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 272/557] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Oct 11 13:15:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:16.180463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e7ef9-0030-49c3-85da-b8c5a7629a0c None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.180463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e7ef9-0030-49c3-85da-b8c5a7629a0c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.180463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e7ef9-0030-49c3-85da-b8c5a7629a0c None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.180463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 273/558] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:16.180463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e7ef9-0030-49c3-85da-b8c5a7629a0c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.211514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.212143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.212409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.212678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.213312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:16.213630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.215013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.227036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 286/559] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:16.227675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.240047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:16.293447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e7ef9-0030-49c3-85da-b8c5a7629a0c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.333896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c329d7e-3622-4867-b325-28027f7b881b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.340281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf866-ee0a-49e0-8299-5917c8121237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.340906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf866-ee0a-49e0-8299-5917c8121237 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.341523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf866-ee0a-49e0-8299-5917c8121237 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.341798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf866-ee0a-49e0-8299-5917c8121237 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.342437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf866-ee0a-49e0-8299-5917c8121237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:16.342951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:16.343126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf866-ee0a-49e0-8299-5917c8121237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.344651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf866-ee0a-49e0-8299-5917c8121237 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.357768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 274/560] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:16.359024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64e488-5d23-4ec3-956c-dccb9c6b3e23 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.359304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64e488-5d23-4ec3-956c-dccb9c6b3e23 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.359569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64e488-5d23-4ec3-956c-dccb9c6b3e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.373847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.374777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.375273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.375748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.378102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-7a64e488-5d23-4ec3-956c-dccb9c6b3e23 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:16.380217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7a64e488-5d23-4ec3-956c-dccb9c6b3e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:16.446066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.447837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.450360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 275/561] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:16.451218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64e488-5d23-4ec3-956c-dccb9c6b3e23 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.510048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:16.565908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 287/562] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:15:16.567135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.579594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:16.590935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64e488-5d23-4ec3-956c-dccb9c6b3e23 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.627204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.628096 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.628555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.628987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.637749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.639740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:16.653687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:16.654639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:16.655592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:16.661376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 276/563] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:16.661376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.684682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662af47-e222-491c-b691-d6f84b91dccb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.720158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.721129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.721619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.722078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.729368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.731123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:16.743192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:16.744344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:16.745207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:16.747530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 288/564] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:16.748632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.764223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:16.769016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1357f33-b913-4419-ab03-c31c4cefcdc0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.804781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.805716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.805993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.806265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.817200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.818262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:16.818629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:16.834573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:16.835642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:16.836553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:16.836553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:16.836553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:16.836553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 277/565] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:16.837139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.856778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f10f2-b579-494e-8539-12a5dd6c27d2 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.890626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.891907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.892346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.892753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.893607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:16.894053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.895505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:16.913971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 289/566] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:16.915789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:16.952825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f4d9-b178-4147-b613-c7a693ce07af None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:16.989145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:16.989864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:16.990137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:16.990406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:16.991013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:16.992495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:17.001569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:17.002543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:17.003507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 278/567] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:17.004941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.021135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.026945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c060ba-b72f-4a5b-9c7b-09fb699abe25 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.054501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.063388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.063999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.064274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.064540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.065215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:17.065513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.066975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.083148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 290/568] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:17.083148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.118258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881fca4-f8d5-496f-8493-c45afca57077 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.154110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.154648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.154953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.155569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.155862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:17.156158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.157530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.175495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 279/569] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:17.175495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.194979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d4c2-bf8d-4e35-9bbb-b46355bfc8e4 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.232029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.232654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.232931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.233199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.244668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.246112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.258068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:17.261997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:17.263477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:17.264494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:17.264494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:17.264494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:17.268085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 291/570] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:17.268915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.291536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d40cb-fd59-4d68-9479-4967999d757d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.311887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.328602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.329222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.329491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.329756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.330381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:17.330680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.332053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.336844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 280/571] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:17.337622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.369746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29e9fd-0ec6-4949-9d6e-018e404c35b4 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.402301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.402991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.403267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.403534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/91dd568b808244adb9337114b2c3986e/roles/d58da09371854b4ab217716b0492fb82` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.418266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=91dd568b808244adb9337114b2c3986e, role_id=d58da09371854b4ab217716b0492fb82)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.419683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.432603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 292/572] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:15:17 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/91dd568b808244adb9337114b2c3986e/roles/d58da09371854b4ab217716b0492fb82 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:15:17.433206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.446328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c245d6-4c23-43ac-8b70-1366f307632b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.489088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f83eee-e1cc-49b8-97a6-f68017d44769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.489744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83eee-e1cc-49b8-97a6-f68017d44769 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.490022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83eee-e1cc-49b8-97a6-f68017d44769 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.490286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f83eee-e1cc-49b8-97a6-f68017d44769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.498036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f83eee-e1cc-49b8-97a6-f68017d44769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.499626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f83eee-e1cc-49b8-97a6-f68017d44769 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.501614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-a7f83eee-e1cc-49b8-97a6-f68017d44769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:17.513774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:17.514757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:17.515656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 281/573] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:17.516904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e833e-c4d9-4130-82a4-cef82ba57412 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.517073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e833e-c4d9-4130-82a4-cef82ba57412 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.517343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e833e-c4d9-4130-82a4-cef82ba57412 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.523821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 282/574] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:17.523821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e833e-c4d9-4130-82a4-cef82ba57412 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.548026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.560579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14f70-e8bd-43a5-9177-98f8e8d5bc31 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.600599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.601759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.602281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.602755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.603429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:17.603732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.605137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.618022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 293/575] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:17.619356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.638943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e833e-c4d9-4130-82a4-cef82ba57412 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.678169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33557303-f9a8-486b-8320-68a4965cd266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.678696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557303-f9a8-486b-8320-68a4965cd266 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.679003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557303-f9a8-486b-8320-68a4965cd266 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.679427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557303-f9a8-486b-8320-68a4965cd266 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.680057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33557303-f9a8-486b-8320-68a4965cd266 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:17.680365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33557303-f9a8-486b-8320-68a4965cd266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.681735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33557303-f9a8-486b-8320-68a4965cd266 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.691723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 283/576] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:17.691723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9865f-1e51-485b-b256-e01c616fa0e5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.691723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9865f-1e51-485b-b256-e01c616fa0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.691723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9865f-1e51-485b-b256-e01c616fa0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.707784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3ac9865f-1e51-485b-b256-e01c616fa0e5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:17.709026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3ac9865f-1e51-485b-b256-e01c616fa0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:17.728952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855cb4e-c6f1-4db3-a06b-8bdd9b8861af None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.762778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.763402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.763674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.763940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.764619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:17.764917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.766335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.769525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.783130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 294/577] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:17.783130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.785931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 284/578] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:17.790921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9865f-1e51-485b-b256-e01c616fa0e5 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.792574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:17.887031 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13699e-176f-4b10-a6ed-48e29bfde196 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.925297 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.925936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.926288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.926621 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.927553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9865f-1e51-485b-b256-e01c616fa0e5 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:17.935073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.936711 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:17.949005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:17.949938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:17.950955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:17.955208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 295/579] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:17.956434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:17.965188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:17.966313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:17.966591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:17.966882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:17.967593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] RBAC: Adding query filter params (interface=public, service_id=2ff21ae347d242d895685226a1aa6cc5, region_id=RegionOne) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:17.967901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:17.969848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:17.980628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 285/580] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/endpoints?service_id=2ff21ae347d242d895685226a1aa6cc5&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:17.981517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:18.032652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:18.057057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:18.069462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd75c-322d-4c1c-a55c-a3fbd6bac2a1 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.104083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.104680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.104976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.105221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.105936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=c81304f420a447a1a488a941d4075513) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:18.106233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.107689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.110137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb146f-6a13-4be7-a48d-bf056cecce4a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.114482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 296/581] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/role_assignments?user.id=c81304f420a447a1a488a941d4075513&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:18.115624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:18.148868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.149311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.149528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.149774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.150487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:18.150785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.152306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.172523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 286/582] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:18.174165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:18.267863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45c8c-be49-4791-aa77-d4a5bc55f580 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.282023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926985-2c90-4155-8642-a75144c1ca52 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.304240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:18.318285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.318952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.319233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.319741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.320186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.321810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.323265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:18.327399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.327995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.328508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.328508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] PATH_INFO: `/v3/services/network` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.329766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.330309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.339320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 297/583] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:18 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:18.340605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:18.340901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:18.341929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:18.342793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 287/584] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:18 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:18.351331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:18.513996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8831-49ae-45ad-b107-77964f4d59df None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.555416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.556378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.556885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.557226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac74195-58f5-45fa-ba42-c6bc59be0ea0 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.557610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.558437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] RBAC: Adding query filter params (name=network) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:18.559019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.560736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.566444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 288/585] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:18.573030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:18.601422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.602923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.603646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.604098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/49febc522c0845be9c92b13169bdbc68/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.606303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=49febc522c0845be9c92b13169bdbc68, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.608943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.627782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 298/586] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:15:18 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/49febc522c0845be9c92b13169bdbc68/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:15:18.639169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:18.694719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4416b0-fab6-4791-b6b6-c42e2ce61627 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.730625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.731274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.731590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.731820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.732454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] RBAC: Adding query filter params (type=network) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:18.732755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.734116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.739731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 289/587] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:18.748076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:18.840290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:18.891102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82e98-d1e5-4160-b41f-0341108ec0c7 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:18.930595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50499b10-94d3-4fb7-a5db-96b97af9bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:18.931239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50499b10-94d3-4fb7-a5db-96b97af9bd75 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:18.931516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50499b10-94d3-4fb7-a5db-96b97af9bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:18.931781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50499b10-94d3-4fb7-a5db-96b97af9bd75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:18.932483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50499b10-94d3-4fb7-a5db-96b97af9bd75 None admin] RBAC: Adding query filter params (interface=public, service_id=3b0377690c2b4e9284d6e981bd968d34, region_id=RegionOne) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:18.932788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50499b10-94d3-4fb7-a5db-96b97af9bd75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:18.934199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50499b10-94d3-4fb7-a5db-96b97af9bd75 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:18.942366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 299/588] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:15:18 2022] GET /identity/v3/endpoints?service_id=3b0377690c2b4e9284d6e981bd968d34&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:18.948246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:19.082687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf46847-0338-4cef-8aaf-82e359d5c693 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:19.095088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:19.136180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607102a3-ab83-4ead-9e98-12bcdc3786ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:19.136802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607102a3-ab83-4ead-9e98-12bcdc3786ba None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:19.137083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607102a3-ab83-4ead-9e98-12bcdc3786ba None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:19.137351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607102a3-ab83-4ead-9e98-12bcdc3786ba None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:19.137964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607102a3-ab83-4ead-9e98-12bcdc3786ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:19.139355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607102a3-ab83-4ead-9e98-12bcdc3786ba None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:19.145098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 290/589] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:18 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:19.736473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ca1f-8189-4711-9870-5f76a5e10e60 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:19.737186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ca1f-8189-4711-9870-5f76a5e10e60 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:19.737661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8ca1f-8189-4711-9870-5f76a5e10e60 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:19.739475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 300/590] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:19.745399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a025-5e9f-49cb-862d-9d0fa56368cc None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:19.745915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a025-5e9f-49cb-862d-9d0fa56368cc None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:19.746403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a025-5e9f-49cb-862d-9d0fa56368cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:19.765836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6f49a025-5e9f-49cb-862d-9d0fa56368cc None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:19.767358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6f49a025-5e9f-49cb-862d-9d0fa56368cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:19.849885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 291/591] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:20.224736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ca1f-8189-4711-9870-5f76a5e10e60 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:20.356465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8ca1f-8189-4711-9870-5f76a5e10e60 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:20.387056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:20.409010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:20.409654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:20.409929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:20.410254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:20.421931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:20.426751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:20.427687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:20.428512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 301/592] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:15:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:20.433975 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49a025-5e9f-49cb-862d-9d0fa56368cc None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:20.587359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49a025-5e9f-49cb-862d-9d0fa56368cc None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:20.588818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:20.645902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561051f4-0fc7-46ab-8eb8-fe5718868d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:20.646518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561051f4-0fc7-46ab-8eb8-fe5718868d44 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:20.646793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561051f4-0fc7-46ab-8eb8-fe5718868d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:20.647083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561051f4-0fc7-46ab-8eb8-fe5718868d44 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:20.647807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561051f4-0fc7-46ab-8eb8-fe5718868d44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:20.648112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561051f4-0fc7-46ab-8eb8-fe5718868d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:20.649495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561051f4-0fc7-46ab-8eb8-fe5718868d44 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:20.662361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 292/593] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:20.668235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:20.738713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63440e-3d0e-432b-8eb0-a40d4d57d450 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:20.739064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63440e-3d0e-432b-8eb0-a40d4d57d450 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:20.739294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63440e-3d0e-432b-8eb0-a40d4d57d450 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:20.740889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 293/594] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:20.746172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4b49-28ea-46f5-9fea-b00b72a62753 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:20.746452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4b49-28ea-46f5-9fea-b00b72a62753 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:20.746723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4b49-28ea-46f5-9fea-b00b72a62753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:20.775564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-aa9c4b49-28ea-46f5-9fea-b00b72a62753 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:20.777319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-aa9c4b49-28ea-46f5-9fea-b00b72a62753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:20.826697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975bf0-5f00-41e8-a345-5fd446d02030 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:20.886622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:20.887207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:20.887486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:20.887755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:20.908043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:20.909526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:20.911446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 294/595] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:20.926671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:20.927685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:20.928556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:20.928556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:20.928556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:20.928556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 302/596] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:20.933786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4b49-28ea-46f5-9fea-b00b72a62753 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.028426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:21.035494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4b49-28ea-46f5-9fea-b00b72a62753 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.070519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:21.071166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.071446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.071717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.072365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:21.072727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:21.074158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:21.086073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 295/597] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:21.091657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.128020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:21.194431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.219828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc961-fb16-4090-84a1-5430b3887a4e None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.269508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf95310-3c35-4028-92ab-8a95a9e9cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:21.270262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf95310-3c35-4028-92ab-8a95a9e9cb89 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.270475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf95310-3c35-4028-92ab-8a95a9e9cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.270750 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf95310-3c35-4028-92ab-8a95a9e9cb89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.286603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf95310-3c35-4028-92ab-8a95a9e9cb89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:21.288942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf95310-3c35-4028-92ab-8a95a9e9cb89 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-6cf95310-3c35-4028-92ab-8a95a9e9cb89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:21.311158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:21.312276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:21.313198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 303/598] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:21.314271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29b7e-c8c8-40df-96e1-82ee18647f0d None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.314365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29b7e-c8c8-40df-96e1-82ee18647f0d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.318843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29b7e-c8c8-40df-96e1-82ee18647f0d None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.320441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 304/599] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:21.323984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e29b7e-c8c8-40df-96e1-82ee18647f0d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.366631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b350f-9b86-4455-a15a-354e9e73c452 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.409728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d070d06-29df-49fb-a050-35fec524e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:21.410382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070d06-29df-49fb-a050-35fec524e38c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.410663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070d06-29df-49fb-a050-35fec524e38c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.410991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070d06-29df-49fb-a050-35fec524e38c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.412262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d070d06-29df-49fb-a050-35fec524e38c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:21.412967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d070d06-29df-49fb-a050-35fec524e38c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-6d070d06-29df-49fb-a050-35fec524e38c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:21.422964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:21.423970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:21.424831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:21.429056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 296/600] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:21.430967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61a9c9-d954-4f96-833d-92ec0e6fe475 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.431274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61a9c9-d954-4f96-833d-92ec0e6fe475 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.431678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61a9c9-d954-4f96-833d-92ec0e6fe475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.443731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:21.451887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6c61a9c9-d954-4f96-833d-92ec0e6fe475 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:21.453070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6c61a9c9-d954-4f96-833d-92ec0e6fe475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:21.455766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e29b7e-c8c8-40df-96e1-82ee18647f0d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.471241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:21.494927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:21.495951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.496444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.496949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.497904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:21.498409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:21.499885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:21.517321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 305/601] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:21.518138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.528349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 297/602] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:21.529890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e9ddd-c5e8-4341-8d54-bd71ab360564 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.530354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e9ddd-c5e8-4341-8d54-bd71ab360564 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.530800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e9ddd-c5e8-4341-8d54-bd71ab360564 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.532298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 298/603] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:21.533182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e9ddd-c5e8-4341-8d54-bd71ab360564 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.639961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b5f5-d012-43d9-8646-cb0c060c81d1 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.646501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e9ddd-c5e8-4341-8d54-bd71ab360564 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.676872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fe11f-a334-45a7-8ec8-e54c8e281382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:21.677832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe11f-a334-45a7-8ec8-e54c8e281382 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.678331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe11f-a334-45a7-8ec8-e54c8e281382 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.678835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe11f-a334-45a7-8ec8-e54c8e281382 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.679712 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fe11f-a334-45a7-8ec8-e54c8e281382 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:21.680216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fe11f-a334-45a7-8ec8-e54c8e281382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:21.681820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fe11f-a334-45a7-8ec8-e54c8e281382 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:21.682130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:21.682746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.683110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.683384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.693377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 306/604] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:21.695068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebceb56-fe13-4c00-acbf-c3d1c2d85183 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.695585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebceb56-fe13-4c00-acbf-c3d1c2d85183 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.696055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebceb56-fe13-4c00-acbf-c3d1c2d85183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.703145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:21.715024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bebceb56-fe13-4c00-acbf-c3d1c2d85183 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:21.716526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bebceb56-fe13-4c00-acbf-c3d1c2d85183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:21.729653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:21.763970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:21.765588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:21.799156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 307/605] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:21.800423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebceb56-fe13-4c00-acbf-c3d1c2d85183 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.876473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 299/606] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:15:21.877313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.922235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebceb56-fe13-4c00-acbf-c3d1c2d85183 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.929938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:21.956423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1047b0-191b-4688-a6a6-f70c5aa05d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:21.957074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1047b0-191b-4688-a6a6-f70c5aa05d2a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.957346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1047b0-191b-4688-a6a6-f70c5aa05d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.957608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1047b0-191b-4688-a6a6-f70c5aa05d2a None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.958227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1047b0-191b-4688-a6a6-f70c5aa05d2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:21.958625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1047b0-191b-4688-a6a6-f70c5aa05d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:21.960021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1047b0-191b-4688-a6a6-f70c5aa05d2a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:21.975060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 308/607] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:21.975060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186c7d-e15a-4c89-a37e-c435746fc36b None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:21.975060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186c7d-e15a-4c89-a37e-c435746fc36b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:21.975060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186c7d-e15a-4c89-a37e-c435746fc36b None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:21.975060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 309/608] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:21.976229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186c7d-e15a-4c89-a37e-c435746fc36b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:21.994119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe4e0-f669-44de-90fd-0035983b6379 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:21.995487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.036608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f41143-e0c5-4e72-a3af-ac5240732d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.037261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f41143-e0c5-4e72-a3af-ac5240732d00 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.037589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f41143-e0c5-4e72-a3af-ac5240732d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.037865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f41143-e0c5-4e72-a3af-ac5240732d00 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.038976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f41143-e0c5-4e72-a3af-ac5240732d00 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.041037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f41143-e0c5-4e72-a3af-ac5240732d00 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-48f41143-e0c5-4e72-a3af-ac5240732d00 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:22.052568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:22.053640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:22.054707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 300/609] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:22.055550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92acd-386c-43a3-ac7a-cf6772f9d85e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.056153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92acd-386c-43a3-ac7a-cf6772f9d85e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.056153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92acd-386c-43a3-ac7a-cf6772f9d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.083099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cfe92acd-386c-43a3-ac7a-cf6772f9d85e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:22.084868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cfe92acd-386c-43a3-ac7a-cf6772f9d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:22.122960 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186c7d-e15a-4c89-a37e-c435746fc36b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.162567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.163238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.163951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.164223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.168530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 301/610] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:22.169700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92acd-386c-43a3-ac7a-cf6772f9d85e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.175214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.176672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:22.191902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:22.192910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:22.193754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:22.193754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:22.193754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:22.193754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 310/611] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:22.193988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.219501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.277977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92acd-386c-43a3-ac7a-cf6772f9d85e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.283014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.322218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.323393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.324194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.324910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.325755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:22.326272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.326394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cfe7d-1edc-4955-9c34-d86611514414 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.328159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.334940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 302/612] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:22.336138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.368688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.369324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.369593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.369900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.380675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:22.385590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:22.386489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:22.387357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 311/613] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:22.388025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.454711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5ed17-226f-4136-8e92-411c2157a521 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.463361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.492666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.493620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.494141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.494479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.495167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:22.495530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.496895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.509292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da377a-cda0-4c9e-ba1d-54af2f167abe None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.514369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 303/614] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:22.514369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.532282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.545591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.546206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.546478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.546740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.547390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:22.547684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.549054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.558833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 312/615] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:22.558833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.631907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf4700-86ad-4e79-9d34-bfb80af8f848 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.659339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d9ca-e9fd-4192-91cd-b8a1ccb98899 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.669996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.670612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.671021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.671298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.671962 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:22.672264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.673733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.688769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 304/616] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:22.688769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.699775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.700383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.700663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.700942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] PATH_INFO: `/v3/services/network` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.701529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.702945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:22.712030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:22.713100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:22.713993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 313/617] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:22.714893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.722021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.771484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.796423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6051-b0c9-4fdf-8295-b4e3701f304e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.822177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa103b4-b55d-4109-a5a2-e9d283416263 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:22.831157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.831998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.832275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.832547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.839581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.841016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:22.852833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:22.853746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:22.854616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 305/618] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:22.855836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.861881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:22.862494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:22.862775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:22.863080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:22.863723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:22.865132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:22.898854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 314/619] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:22.898854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:22.971709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:22.987495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f79259-4c17-435b-9655-eb065dbc57c7 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.034874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.035115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f804c7-3cfd-4341-adde-9ca828b8c07a None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.035695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.036068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.036434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.044459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:23.053416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.055660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:23.073203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:23.074457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:23.075548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:23.075548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:23.075548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:23.076564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 306/620] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:23.077538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:23.095769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.096517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.096942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.097259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.097986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] RBAC: Adding query filter params (name=network) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:23.098295 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.100000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.106300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 315/621] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:23.106988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:23.207077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d78f24-28d9-422d-894a-7be163c5f776 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.224887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3412b-1ef5-45ca-8860-14f307d12790 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.249501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.250129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.250455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.250733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.251483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:23.251789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.253335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.256319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:23.268176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.268784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.268902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 307/622] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:23.269060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.269323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.269689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:23.269965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:23.270263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.271689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.284719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 316/623] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:23.285743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:23.329602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:23.394520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ee12-63d0-4609-a081-ede74194e147 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.430602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861e190-0599-4dfe-b479-236f73f4dea9 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.431844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.432463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.432740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.433006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.433686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] RBAC: Adding query filter params (type=network) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:23.433993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.435539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.440382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 308/624] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:23.441170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:23.483231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.483840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.484111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.484377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.485095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] RBAC: Adding query filter params (role.id=d58da09371854b4ab217716b0492fb82, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=91dd568b808244adb9337114b2c3986e) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:23.485394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.486858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.495482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 317/625] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:23 2022] GET /identity/v3/role_assignments?user.id=91dd568b808244adb9337114b2c3986e&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=d58da09371854b4ab217716b0492fb82 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:23.496610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:23.510164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:23.614059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9085e-144a-40c1-ad13-ba0131475f7e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.614271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:23.623405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb82b5-8eee-4b22-9e47-4e1ba42ad5c4 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.665890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.667328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.667799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.668205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.669072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.670659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.696945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.697227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 318/626] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:23.697646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.697928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.698194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.720391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.722037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:23.744713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:23.745726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:23.747077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 309/627] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:23.752046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:23.898331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee5e1f-10df-4280-8f10-95846c090bcc None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:23.937973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb31c0-9b4b-400f-8e11-2b8d09155b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:23.938583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb31c0-9b4b-400f-8e11-2b8d09155b93 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:23.938887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb31c0-9b4b-400f-8e11-2b8d09155b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:23.939163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb31c0-9b4b-400f-8e11-2b8d09155b93 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:23.939889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb31c0-9b4b-400f-8e11-2b8d09155b93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:23.940194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb31c0-9b4b-400f-8e11-2b8d09155b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:23.941631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb31c0-9b4b-400f-8e11-2b8d09155b93 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:23.960208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 319/628] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Oct 11 13:15:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:23.966746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:24.086143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4834-0d4b-4e30-8ce7-46ddeaba249d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:24.107568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:24.122270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:24.123287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:24.123789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:24.124332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:24.200499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:24.202356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:24.282456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ce01-e266-41af-a60c-9349a812a507 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:24.282791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ce01-e266-41af-a60c-9349a812a507 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:24.283030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ce01-e266-41af-a60c-9349a812a507 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:24.284516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 320/629] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:24.290213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581318-4410-41da-b878-4bd2a054ab42 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:24.291203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581318-4410-41da-b878-4bd2a054ab42 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:24.291663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581318-4410-41da-b878-4bd2a054ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:24.300440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:24.311596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-dc581318-4410-41da-b878-4bd2a054ab42 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:24.312696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 310/630] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:23 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:15:24.313505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-dc581318-4410-41da-b878-4bd2a054ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:24.319083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:24.350324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:24.406429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 321/631] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:24.443858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119bf6-e580-4b9e-8646-5b4785a1bc0e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:24.479541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:24.480529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:24.481020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:24.481531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:24.492233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:24.493991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:24.509793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:24.511280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:24.512186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:24.512186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:24.512186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:24.514235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 311/632] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:24.520115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581318-4410-41da-b878-4bd2a054ab42 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:24.623132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581318-4410-41da-b878-4bd2a054ab42 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:24.662232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:24.663252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:24.664127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:24.664609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:24.665450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:24.665963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:24.667596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:24.669272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:24.681277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 322/633] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:24.687111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:24.702053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:24.780708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:24.816415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddec02f-d45c-4e5f-88f8-099e21aa252e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:24.821922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bbaae-eea7-487b-b664-9d511eea53f3 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:24.853363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:24.854443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:24.854940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:24.855404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:24.857105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:24.857820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:24.858252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:24.858625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:24.859453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:24.860954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:24.863637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:24.865420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:24.877687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:24.886121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:24.887016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:24.887440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 323/634] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:24 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:24.887520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 312/635] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:24.887599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:24.955177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:25.008640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c770ec-671d-465b-b3af-cf2757478080 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:25.048131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13949dfc-a6ff-4bfc-a13f-778ca4119a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:25.048677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949dfc-a6ff-4bfc-a13f-778ca4119a5c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:25.048954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949dfc-a6ff-4bfc-a13f-778ca4119a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:25.049220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13949dfc-a6ff-4bfc-a13f-778ca4119a5c None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:25.049921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13949dfc-a6ff-4bfc-a13f-778ca4119a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:25.050226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13949dfc-a6ff-4bfc-a13f-778ca4119a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:25.051707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13949dfc-a6ff-4bfc-a13f-778ca4119a5c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:25.065759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 324/636] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:25.072134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:25.180747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61d08-4452-4e8b-b6d8-9b803e6b4fa3 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:25.195964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b04464-b287-4cfc-a6ad-e52a57449ec3 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:25.196261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b04464-b287-4cfc-a6ad-e52a57449ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:25.196518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b04464-b287-4cfc-a6ad-e52a57449ec3 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:25.198106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 325/637] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:25.203262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fae65d-e8d4-499b-b3ab-67713767cf29 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:25.203560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fae65d-e8d4-499b-b3ab-67713767cf29 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:25.203822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fae65d-e8d4-499b-b3ab-67713767cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:25.212659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:25.219940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:25.220958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:25.221284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:25.221502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:25.222178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-80fae65d-e8d4-499b-b3ab-67713767cf29 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:25.222296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=49febc522c0845be9c92b13169bdbc68) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:25.222519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:25.223422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-80fae65d-e8d4-499b-b3ab-67713767cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:25.224053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:25.230787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 313/638] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:25 2022] GET /identity/v3/role_assignments?user.id=49febc522c0845be9c92b13169bdbc68&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:25.304643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 326/639] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:25 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:25.588977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:25.694285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197289e-c963-43cc-a28a-8fe2400d3c09 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:25.729647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:25.730287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:25.730558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:25.730836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:25.731431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:25.732782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:25.741888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:25.742870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:25.743705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 314/640] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:25.750939 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fae65d-e8d4-499b-b3ab-67713767cf29 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:25.794832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:25.855849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fae65d-e8d4-499b-b3ab-67713767cf29 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:25.896141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675f35-f526-4c73-a444-9db4ad9e7816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:25.896704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675f35-f526-4c73-a444-9db4ad9e7816 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:25.896978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675f35-f526-4c73-a444-9db4ad9e7816 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:25.897245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675f35-f526-4c73-a444-9db4ad9e7816 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:25.897928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675f35-f526-4c73-a444-9db4ad9e7816 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:25.898328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675f35-f526-4c73-a444-9db4ad9e7816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:25.899718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675f35-f526-4c73-a444-9db4ad9e7816 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:25.904796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 327/641] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:25.912081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:25.980710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:26.023298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694f40-68ea-4542-87bf-5d09217e96be None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:26.058055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bc553-fbb8-44cd-a499-ff69b1bab7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:26.059052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bc553-fbb8-44cd-a499-ff69b1bab7ba None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:26.059566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bc553-fbb8-44cd-a499-ff69b1bab7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:26.060053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bc553-fbb8-44cd-a499-ff69b1bab7ba None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:26.061091 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bc553-fbb8-44cd-a499-ff69b1bab7ba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:26.061592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bc553-fbb8-44cd-a499-ff69b1bab7ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:26.063188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bc553-fbb8-44cd-a499-ff69b1bab7ba None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:26.068510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 315/642] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:26.068767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f978-738d-49eb-b79b-72444786435a None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:26.069058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f978-738d-49eb-b79b-72444786435a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:26.069328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f978-738d-49eb-b79b-72444786435a None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:26.070902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 328/643] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:26.076571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d01fd-16be-4e6a-893e-bd37524cbada None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:26.076858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d01fd-16be-4e6a-893e-bd37524cbada None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:26.077128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d01fd-16be-4e6a-893e-bd37524cbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:26.097658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6f1d01fd-16be-4e6a-893e-bd37524cbada None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:26.098942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6f1d01fd-16be-4e6a-893e-bd37524cbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:26.179629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 316/644] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:26 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:26.450135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014f978-738d-49eb-b79b-72444786435a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:26.554462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014f978-738d-49eb-b79b-72444786435a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:26.556987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:26.591545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:26.592178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:26.592458 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:26.592723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:26.603442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:26.608213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:26.609153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:26.610032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 329/645] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Oct 11 13:15:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:26.615223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d01fd-16be-4e6a-893e-bd37524cbada None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:26.670965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:26.715500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d01fd-16be-4e6a-893e-bd37524cbada None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:26.749443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:26.750061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:26.750331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:26.750598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:26.751286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:26.751584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:26.752948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:26.761474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 317/646] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Oct 11 13:15:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:26.766955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:26.869678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc22578-ed49-41c3-b4ab-300202b29ce3 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:26.905120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:26.905754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:26.906035 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:26.906306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:26.917338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:26.918877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:26.934181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:26.935355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:26.936473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:26.936473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:26.936473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:26.936473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 330/647] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:26.941371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.048162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfb7f-d6cd-4b32-b1a6-9fe7f8deaee3 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.071210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:27.082494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7f893-8e97-429c-a080-f843eda73f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:27.083133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7f893-8e97-429c-a080-f843eda73f8c None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.083413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7f893-8e97-429c-a080-f843eda73f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.083877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7f893-8e97-429c-a080-f843eda73f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.084517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7f893-8e97-429c-a080-f843eda73f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:27.084812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7f893-8e97-429c-a080-f843eda73f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:27.086470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7f893-8e97-429c-a080-f843eda73f8c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:27.098834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 318/648] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:27.104847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.125596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:27.217306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3b98-e76e-4fbf-9255-7008e9b11a32 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.251971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:27.252605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.252880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.253149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.261223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:27.262669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:27.267125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b47b3-6232-41b3-b8fb-953448d86794 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.267402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b47b3-6232-41b3-b8fb-953448d86794 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.267684 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b47b3-6232-41b3-b8fb-953448d86794 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.269294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 319/649] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:27.274111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:27.275074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:27.275997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:27.276529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9609f-d91d-4859-bc55-cc22c3a79ba9 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.276529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9609f-d91d-4859-bc55-cc22c3a79ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.276529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9609f-d91d-4859-bc55-cc22c3a79ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.276723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 331/650] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:15:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:27.283761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.299211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2dc9609f-d91d-4859-bc55-cc22c3a79ba9 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:27.300385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2dc9609f-d91d-4859-bc55-cc22c3a79ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:27.380427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 320/651] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:27 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:27.394241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:27.410216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a9146-7bd9-4d6e-93e3-7707ef0ca88d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.449077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62d924-b2b4-43e5-9462-904e1783a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:27.450126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62d924-b2b4-43e5-9462-904e1783a8dd None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.450607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62d924-b2b4-43e5-9462-904e1783a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.451546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62d924-b2b4-43e5-9462-904e1783a8dd None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.452560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62d924-b2b4-43e5-9462-904e1783a8dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:27.453103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62d924-b2b4-43e5-9462-904e1783a8dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:27.454797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62d924-b2b4-43e5-9462-904e1783a8dd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:27.474284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 332/652] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Oct 11 13:15:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:27.480659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9609f-d91d-4859-bc55-cc22c3a79ba9 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.552714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d52f40-27f1-4ce2-9d32-d40e5e8c7c00 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.552904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d52f40-27f1-4ce2-9d32-d40e5e8c7c00 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.553289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d52f40-27f1-4ce2-9d32-d40e5e8c7c00 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.554940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 333/653] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:27.559893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9e58-7823-4e00-8902-624bf67c66ca None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.560176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9e58-7823-4e00-8902-624bf67c66ca None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.560451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9e58-7823-4e00-8902-624bf67c66ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.578410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d68a9e58-7823-4e00-8902-624bf67c66ca None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:27.579625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d68a9e58-7823-4e00-8902-624bf67c66ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:27.592366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9609f-d91d-4859-bc55-cc22c3a79ba9 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.608012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:27.637057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:27.639021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.639750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.640221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.653938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:27.655690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:27.656508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 334/654] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:27 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:27.671613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:27.672568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:27.673445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:27.673445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:27.673445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:27.675536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 321/655] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:27.681697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a9e58-7823-4e00-8902-624bf67c66ca None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.697570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.747689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:27.788878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a9e58-7823-4e00-8902-624bf67c66ca None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.802660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097fb96-8c9f-42a1-ac94-4e3892c5e011 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.825233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:27.826179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.826669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.827168 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.828003 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:27.828516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:27.830099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:27.847538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:27.847538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:27.847538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:27.847538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:27.847937 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:27.847937 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:27.848301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 335/656] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:27.849438 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:27.856641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:27.857633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:27.858511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:27.862705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 322/657] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Oct 11 13:15:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:27.864108 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:27.920605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:27.961431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d54721-9e79-46b5-8a33-fcb71d20d6a9 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.980711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fffa23-1f91-4af3-9eb0-5d065cc6913f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:27.986309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:27.999281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.000316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.000920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.001369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.010204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.012600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.018844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.019462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.019739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.020012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.020640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:28.020945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.022310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.027207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 323/658] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:28.027443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:28.028292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:28.029169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:28.029585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.031116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 336/659] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:28.032756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.134491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:28.142057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801f3bd-377c-4451-84d3-5f4e46183b03 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.152906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4bedd-bde4-46ae-896b-f6384f76800f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.181109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.181750 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.182039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.182310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.182989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:28.183292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.184702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.194587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.195287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 337/660] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:28.195396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.195599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.195862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.196091 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.196523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.197795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:28.206797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:28.207802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:28.208606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 324/661] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:28.209378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.253214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:28.305635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57d658-1cf1-4f37-b8ac-9773714adc01 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.311843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f604-6b95-4368-ac1b-def5345b9824 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.340832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d121986-beb2-4f1a-ba4f-38e394a74948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.341448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121986-beb2-4f1a-ba4f-38e394a74948 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.341723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121986-beb2-4f1a-ba4f-38e394a74948 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.341996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121986-beb2-4f1a-ba4f-38e394a74948 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.342692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d121986-beb2-4f1a-ba4f-38e394a74948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:28.343053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d121986-beb2-4f1a-ba4f-38e394a74948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.344497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d121986-beb2-4f1a-ba4f-38e394a74948 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.346620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.347267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.347544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.347813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.348505 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] RBAC: Adding query filter params (interface=public, service_id=31418d77993d405bb400807c03b98f9f, region_id=RegionOne) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:28.348808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.350157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.356281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 325/662] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:15:28 2022] GET /identity/v3/endpoints?service_id=31418d77993d405bb400807c03b98f9f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:28.361522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 338/663] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:28.361685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.361779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16b69-86c9-4c34-8149-3e3041c259a4 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.361779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16b69-86c9-4c34-8149-3e3041c259a4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.361779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16b69-86c9-4c34-8149-3e3041c259a4 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.361779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 339/664] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:28.362084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16b69-86c9-4c34-8149-3e3041c259a4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.377922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:28.460562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e2c4-51fd-487c-b004-11efbe1c806e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.464048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16b69-86c9-4c34-8149-3e3041c259a4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.474001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:28.495118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.495725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.495996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.496261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.496888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:28.497187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.498335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d29100-6fdf-4628-b67d-21fe7a825456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.498540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.498967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d29100-6fdf-4628-b67d-21fe7a825456 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.499241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d29100-6fdf-4628-b67d-21fe7a825456 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.499501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d29100-6fdf-4628-b67d-21fe7a825456 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.500092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d29100-6fdf-4628-b67d-21fe7a825456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.501437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d29100-6fdf-4628-b67d-21fe7a825456 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.503195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 326/665] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:28.503936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.507049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 340/666] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:28 2022] GET /identity/v3/services => generated 1029 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:15:28.508978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd520122-b6bd-4c0a-8cd3-309d26ac0b2c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.509237 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd520122-b6bd-4c0a-8cd3-309d26ac0b2c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.509505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd520122-b6bd-4c0a-8cd3-309d26ac0b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.531190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-cd520122-b6bd-4c0a-8cd3-309d26ac0b2c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:28.532437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cd520122-b6bd-4c0a-8cd3-309d26ac0b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:28.604803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:28.615014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 341/667] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:28 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:28.616024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd520122-b6bd-4c0a-8cd3-309d26ac0b2c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.637013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b7cdd-6745-4205-922b-138579486e50 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.687126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.688630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.688909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.689179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/91dd568b808244adb9337114b2c3986e/roles/57552e48d4024cd5af71ab0b13705f51` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.691753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=91dd568b808244adb9337114b2c3986e, role_id=57552e48d4024cd5af71ab0b13705f51)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.693979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.713050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 327/668] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:15:28 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/91dd568b808244adb9337114b2c3986e/roles/57552e48d4024cd5af71ab0b13705f51 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:15:28.731817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd520122-b6bd-4c0a-8cd3-309d26ac0b2c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:28.733721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:28.774790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c04244-6a39-461f-8e3f-0ab9a5b59df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:28.775439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c04244-6a39-461f-8e3f-0ab9a5b59df7 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:28.775720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c04244-6a39-461f-8e3f-0ab9a5b59df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:28.775989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c04244-6a39-461f-8e3f-0ab9a5b59df7 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:28.776675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c04244-6a39-461f-8e3f-0ab9a5b59df7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:28.776979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c04244-6a39-461f-8e3f-0ab9a5b59df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:28.778437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c04244-6a39-461f-8e3f-0ab9a5b59df7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:28.784626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 342/669] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:28.883479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:28.999251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979243-e11c-4b43-b862-d02315ab8488 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:29.034382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d27df-9b72-4440-a8f2-90932d00dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:29.035029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d27df-9b72-4440-a8f2-90932d00dcb3 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:29.035307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d27df-9b72-4440-a8f2-90932d00dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:29.035579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d27df-9b72-4440-a8f2-90932d00dcb3 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:29.036236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d27df-9b72-4440-a8f2-90932d00dcb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:29.037604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d27df-9b72-4440-a8f2-90932d00dcb3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:29.051087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:29.058384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 328/670] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:28 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:30.749347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e903-dbf3-4e97-910b-5c45c84916c4 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:30.749916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e903-dbf3-4e97-910b-5c45c84916c4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:30.750172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e903-dbf3-4e97-910b-5c45c84916c4 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:30.752057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 343/671] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:30.757684 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518668-6c38-4120-b5e3-c75dedc0dddd None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:30.758127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518668-6c38-4120-b5e3-c75dedc0dddd None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:30.758230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518668-6c38-4120-b5e3-c75dedc0dddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:30.776976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f4518668-6c38-4120-b5e3-c75dedc0dddd None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:30.778488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f4518668-6c38-4120-b5e3-c75dedc0dddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:30.861467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 329/672] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:30.954605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e34ed-3761-45d8-bab3-972c3b8372c7 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:30.954982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e34ed-3761-45d8-bab3-972c3b8372c7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:30.955176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e34ed-3761-45d8-bab3-972c3b8372c7 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:30.956772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 344/673] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:30.959133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b925a-b6fe-4b53-9334-997515fea00e None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:30.959658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b925a-b6fe-4b53-9334-997515fea00e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:30.960302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b925a-b6fe-4b53-9334-997515fea00e None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:30.962110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 330/674] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:30.962217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40317ba-d09c-49b0-85a5-ab05f3be0b3e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:30.962470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40317ba-d09c-49b0-85a5-ab05f3be0b3e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:30.962744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40317ba-d09c-49b0-85a5-ab05f3be0b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:30.970878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754006de-e505-4e8b-ac87-77857a786051 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:30.971421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754006de-e505-4e8b-ac87-77857a786051 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:30.971909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754006de-e505-4e8b-ac87-77857a786051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:30.983695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f40317ba-d09c-49b0-85a5-ab05f3be0b3e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:30.985011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f40317ba-d09c-49b0-85a5-ab05f3be0b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:30.990916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-754006de-e505-4e8b-ac87-77857a786051 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:30.992367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-754006de-e505-4e8b-ac87-77857a786051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:31.066987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 345/675] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:31.069930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 331/676] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:31.134943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40317ba-d09c-49b0-85a5-ab05f3be0b3e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.236923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:31.243157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40317ba-d09c-49b0-85a5-ab05f3be0b3e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.260691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4012-74f5-431b-816c-f0bce8ef2a38 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.261294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4012-74f5-431b-816c-f0bce8ef2a38 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.261756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4012-74f5-431b-816c-f0bce8ef2a38 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.263625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 332/677] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:31.268828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b46ac-cfc8-451a-94d8-fa7725bb3a64 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.269112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b46ac-cfc8-451a-94d8-fa7725bb3a64 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.269388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b46ac-cfc8-451a-94d8-fa7725bb3a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.283192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.284086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.284592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.285033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.285798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:31.287484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a01b46ac-cfc8-451a-94d8-fa7725bb3a64 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:31.287612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:31.289572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a01b46ac-cfc8-451a-94d8-fa7725bb3a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:31.297927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:31.298892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:31.299800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 346/678] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Oct 11 13:15:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:31.305063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.358156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:31.375585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 333/679] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:31.376767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b46ac-cfc8-451a-94d8-fa7725bb3a64 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.430754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f0499-2f29-4085-847d-3f25e587b562 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.465028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.465641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.465918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.466184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.466971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:31.467275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:31.468702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:31.473860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 347/680] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:31.474686 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.483111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b46ac-cfc8-451a-94d8-fa7725bb3a64 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.500862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:31.520064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.520696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.520970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.521241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.531639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:31.537594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:31.538947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 334/681] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Oct 11 13:15:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:31.544815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.584420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31968b24-399c-4742-9f02-e44c11df9a56 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.589406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:31.623012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.623601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.623879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.624258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.625000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:31.626386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:31.643445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d347b30-be37-4da5-9e01-0b905c47608b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.643641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 348/682] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:31 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:31.644432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.686922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.687621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.687801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.688172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.688736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:31.689041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:31.690462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:31.698870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 335/683] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:31.698870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.745793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:31.767460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad3a3-2059-4803-9a27-736627669f42 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.805480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.806104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.806375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.806638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.807342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:31.807638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:31.809017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:31.809922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0aabd-cd31-4e20-b156-22a4713817c6 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.812492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:31.820334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 349/684] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Oct 11 13:15:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:31.825656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.852014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.852584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.852877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.853197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.853833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:31.855237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:31.864335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:31.865319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:31.866142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 336/685] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:31.867170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:31.938342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe8bdd-b88c-49ab-a4bc-98d66e8c8a6b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.973655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:31.974343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:31.974622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:31.974923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:31.975022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a5e2-5041-4056-8466-5488be9355ab None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:31.975595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:31.977205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.001479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 350/686] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:32.003158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.013921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:32.020839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.021642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.022015 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.022425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.034980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.036621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:32.053915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:32.055223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:32.056374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:32.056374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:32.056374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:32.062476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 337/687] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:32.063660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.085796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:32.165510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ed67-8bcc-416a-8d58-2c1d02f3ff02 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.190456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daa614-751c-40d3-9866-e760283f75fa None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.206022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.206638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.206937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.207207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.207836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:32.208131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.209500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.219389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 351/688] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:32.226635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.238857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.239817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.240093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.240421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.241474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:32.242198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.243637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.257306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 338/689] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:32.263793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.311063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:32.360059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76826-53ff-4c88-9fda-21398e6638d5 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.364956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:32.391998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031148c-f057-4fc5-9c27-1f698da2bbf4 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.399602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.400225 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.400563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.400852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.401771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:32.401958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.403537 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.413975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 352/690] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:32.415815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.438522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.439913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.439913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.439913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.455175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.457843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:32.474902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:32.475953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 13:15:32.476871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:32.479667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 339/691] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:32.485380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.546706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12f00-f07d-4a81-82d2-6a5c9f63e54e None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.592072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:32.601016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729f5e-cb0d-4f6f-9793-76f1838a43fb None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.601714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.602491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.603190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.603636 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.605497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] RBAC: Adding query filter params (interface=public, service_id=d3a413e126ee4795af4d4a161e857c38, region_id=RegionOne) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:32.605970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.607529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.619384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 353/692] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/endpoints?service_id=d3a413e126ee4795af4d4a161e857c38&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:32.620519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.641393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.642050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.642325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.642590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.643379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:32.643676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.645134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.647966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:32.669767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 340/693] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:32.670944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:32.729264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168631-25d3-4a1f-ab8c-30ebb5466459 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.764658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.765643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.766119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.766582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.767425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.769026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:32.773288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e497de-4c2b-4281-9d0a-49936495356b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:32.783239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 354/694] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:15:32.814253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:32.814979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:32.815271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:32.815537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:32.885851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:32.894056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:32.896137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:33.007094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 341/695] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 11 13:15:33.012618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:33.073214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:33.117820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a8c44-5af9-4cd6-adac-eaf5550d63dd None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:33.153082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:33.154087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:33.154564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:33.155058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:33.166805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:33.168535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:33.183564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:33.184503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:33.185380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:33.185380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:33.185380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:33.187445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 355/696] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:33.192730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:33.286632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:33.296291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cc54e-b856-4206-84a1-7830e3cccb70 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:33.342233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:33.342885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:33.343163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:33.343432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:33.344074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:33.344372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:33.345734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:33.358876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 342/697] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:33.364068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:33.474932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfabec-1d2f-4579-abe2-e4ece3ebed1d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:33.486304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:33.512756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:33.513764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:33.514242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:33.514709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:33.522105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:33.523887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:33.535721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:33.536602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:33.537550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:33.540247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 356/698] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:33.548470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:33.644030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292c091-1cf4-43e4-8f0b-024826638574 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:33.681656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9374f-314c-4fe3-9a12-d7dbd5a79112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:33.682279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9374f-314c-4fe3-9a12-d7dbd5a79112 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:33.682554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9374f-314c-4fe3-9a12-d7dbd5a79112 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:33.682835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9374f-314c-4fe3-9a12-d7dbd5a79112 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:33.683548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9374f-314c-4fe3-9a12-d7dbd5a79112 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:33.683850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9374f-314c-4fe3-9a12-d7dbd5a79112 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:33.685280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9374f-314c-4fe3-9a12-d7dbd5a79112 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:33.698084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 343/699] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:33.707996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:33.820278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfe2a7-24cf-4567-8882-39c7bd21f0bb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:33.835367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c81a-f110-469d-b0fb-dec523c7679f None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:33.836283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c81a-f110-469d-b0fb-dec523c7679f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:33.836748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c81a-f110-469d-b0fb-dec523c7679f None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:33.838584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 344/700] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:33.843930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6ea43-6241-4a5d-8c63-d37319f55ac1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:33.844446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6ea43-6241-4a5d-8c63-d37319f55ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:33.844924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6ea43-6241-4a5d-8c63-d37319f55ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:33.856820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:33.857428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:33.857706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:33.857973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:33.859259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] RBAC: Adding query filter params (role.id=57552e48d4024cd5af71ab0b13705f51, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=91dd568b808244adb9337114b2c3986e) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:33.859571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:33.861318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:33.865230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-09d6ea43-6241-4a5d-8c63-d37319f55ac1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:33.866721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-09d6ea43-6241-4a5d-8c63-d37319f55ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:33.874862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 357/701] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:33 2022] GET /identity/v3/role_assignments?user.id=91dd568b808244adb9337114b2c3986e&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=57552e48d4024cd5af71ab0b13705f51 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:33.881639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:33.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 345/702] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:34.226683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:34.261805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:34.300131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da139-145b-45f2-81eb-98bcbd76c0b8 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:34.300445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da139-145b-45f2-81eb-98bcbd76c0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:34.300685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da139-145b-45f2-81eb-98bcbd76c0b8 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:34.302261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 346/703] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:34.307394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274a2a-af5c-435d-803c-dec58cf45026 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:34.307676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274a2a-af5c-435d-803c-dec58cf45026 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:34.307947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274a2a-af5c-435d-803c-dec58cf45026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:34.331675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd92791-f01d-4119-b41e-21f1d528711b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:34.338375 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-92274a2a-af5c-435d-803c-dec58cf45026 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:34.339626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-92274a2a-af5c-435d-803c-dec58cf45026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:34.378223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:34.379161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:34.379442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:34.379713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:34.380311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:34.382398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:34.393532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:34.394546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:34.395394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 358/704] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:34.402550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:34.423876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 347/705] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:34.509788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:34.513828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4049277-081d-4344-b1bb-aa9fe6ba4111 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:34.548884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:34.549503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:34.549785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:34.550059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:34.550692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:34.551094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:34.552490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:34.558391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 359/706] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:34.567941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92274a2a-af5c-435d-803c-dec58cf45026 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:34.651213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:34.674403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92274a2a-af5c-435d-803c-dec58cf45026 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:34.703654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:34.710939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:34.711605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:34.711886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:34.712156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:34.713230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:34.713531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:34.715288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:34.721332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 348/707] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:34.727496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:34.810871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0af86-44d3-4622-8be3-75e255098288 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:34.847979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:34.848643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:34.848870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:34.849139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:34.849718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:34.851231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:34.852562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869fdfd-c1cb-4c77-a6c9-fab541e5e43f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:34.860384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:34.861367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:34.862185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:34.866504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 360/708] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:34.867678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:34.897982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:34.900469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:34.901397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:34.901858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:34.902301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:34.903420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] RBAC: Adding query filter params (interface=public, service_id=53caa140eaf647178884ab4b61a53a3e, region_id=RegionOne) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:34.904291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:34.906142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:34.920356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 349/709] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:15:34 2022] GET /identity/v3/endpoints?service_id=53caa140eaf647178884ab4b61a53a3e&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:34.923281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:34.926122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:35.001092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c915251-8f96-4c78-bf3d-07f1cf8cb44d None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:35.043154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcadd1-5fe9-41f0-a69f-c8d82c3ab130 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:35.043347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5eafb-53b5-425d-889b-b08cf573ac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:35.043813 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5eafb-53b5-425d-889b-b08cf573ac5a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.044090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5eafb-53b5-425d-889b-b08cf573ac5a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.044361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5eafb-53b5-425d-889b-b08cf573ac5a None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.044982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5eafb-53b5-425d-889b-b08cf573ac5a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:35.045283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5eafb-53b5-425d-889b-b08cf573ac5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:35.046659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5eafb-53b5-425d-889b-b08cf573ac5a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:35.052136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 361/710] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:35.053291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a318e-f049-40b1-a1cf-f0c0c1ca6ac8 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.053571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a318e-f049-40b1-a1cf-f0c0c1ca6ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.053889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a318e-f049-40b1-a1cf-f0c0c1ca6ac8 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.055346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 362/711] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:35.062527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3578d-285a-411c-9757-647c8ff22227 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.062838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3578d-285a-411c-9757-647c8ff22227 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.063120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3578d-285a-411c-9757-647c8ff22227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.081736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-b0f3578d-285a-411c-9757-647c8ff22227 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:35.082943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b0f3578d-285a-411c-9757-647c8ff22227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:35.083823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:35.084436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.084708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.085183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.085786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:35.087949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:35.095301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 350/712] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:34 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:15:35.095990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:35.189498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 363/713] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:35.200918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:35.236932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f318ee-ade5-41cb-a789-0aba48327b9b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:35.275270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:35.275888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.276165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.276436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.277088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:35.277383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:35.278752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:35.284166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 351/714] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:35.453575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3578d-285a-411c-9757-647c8ff22227 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:35.475502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:35.559809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3578d-285a-411c-9757-647c8ff22227 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:35.594768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:35.595362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.595639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.595905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.596483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:35.597868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:35.607153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:35.608164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:35.608979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 364/715] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:35.614807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:35.715687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ae6e6-b782-4819-996f-d9eab8e78b3f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:35.743996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:35.750202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:35.751285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.751941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.752460 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.753431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:35.753726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:35.755119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:35.760488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 352/716] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:35.765898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:35.854170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:35.871336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8742-ecac-4498-85c6-490b0d628471 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:35.910264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50ba1-4b50-443b-8958-c28b17223420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:35.911302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50ba1-4b50-443b-8958-c28b17223420 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:35.911780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50ba1-4b50-443b-8958-c28b17223420 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:35.912243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50ba1-4b50-443b-8958-c28b17223420 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:35.913064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50ba1-4b50-443b-8958-c28b17223420 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:35.913930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50ba1-4b50-443b-8958-c28b17223420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:35.915533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50ba1-4b50-443b-8958-c28b17223420 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:35.921439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 365/717] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Oct 11 13:15:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:35.926891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:36.027219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a08ac8-cb87-47fd-bb15-470a435c4230 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:36.070088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc99292-988c-41c4-aafd-ae0d799c7b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:36.070716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc99292-988c-41c4-aafd-ae0d799c7b87 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:36.071020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc99292-988c-41c4-aafd-ae0d799c7b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:36.071284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc99292-988c-41c4-aafd-ae0d799c7b87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:36.071981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc99292-988c-41c4-aafd-ae0d799c7b87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:36.073407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc99292-988c-41c4-aafd-ae0d799c7b87 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:36.099999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 353/718] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:36.188660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d862b-c924-4080-b953-4d1dc668d552 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:36.188838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d862b-c924-4080-b953-4d1dc668d552 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:36.189100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d862b-c924-4080-b953-4d1dc668d552 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:36.190914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 366/719] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:36.197240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002731-0221-4ca0-ba6c-b35505f9e406 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:36.197759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002731-0221-4ca0-ba6c-b35505f9e406 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:36.198168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002731-0221-4ca0-ba6c-b35505f9e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:36.218514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-75002731-0221-4ca0-ba6c-b35505f9e406 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:36.220095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-75002731-0221-4ca0-ba6c-b35505f9e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:36.274761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:36.304063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 354/720] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:36.572996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d862b-c924-4080-b953-4d1dc668d552 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:36.676004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d862b-c924-4080-b953-4d1dc668d552 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:36.710926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:36.711555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:36.711827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:36.712092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] PATH_INFO: `/v3/services/image` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:36.712665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:36.714074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:36.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:36.724149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:36.724946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 367/721] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Oct 11 13:15:36 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:36.732202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75002731-0221-4ca0-ba6c-b35505f9e406 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:36.837243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75002731-0221-4ca0-ba6c-b35505f9e406 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:36.872391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dfe80-3693-4074-a747-26198392c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:36.873008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfe80-3693-4074-a747-26198392c857 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:36.873279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfe80-3693-4074-a747-26198392c857 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:36.873542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfe80-3693-4074-a747-26198392c857 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:36.874166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfe80-3693-4074-a747-26198392c857 None admin] RBAC: Adding query filter params (name=image) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:36.874461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfe80-3693-4074-a747-26198392c857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:36.875844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfe80-3693-4074-a747-26198392c857 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:36.881142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 355/722] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:36.886798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:36.907807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:36.992665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e295416-f50b-4a6f-85c7-678df8c1823c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:37.027009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8a8a3-b980-4dd4-a702-0d38b18f231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:37.027962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a8a3-b980-4dd4-a702-0d38b18f231d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:37.028493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a8a3-b980-4dd4-a702-0d38b18f231d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:37.028961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a8a3-b980-4dd4-a702-0d38b18f231d None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:37.029887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8a8a3-b980-4dd4-a702-0d38b18f231d None admin] RBAC: Adding query filter params (type=image) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:37.030386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8a8a3-b980-4dd4-a702-0d38b18f231d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:37.031966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8a8a3-b980-4dd4-a702-0d38b18f231d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:37.037088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 368/723] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:37.337079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31722142-909c-40db-b769-b93227cec9c3 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:37.337897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31722142-909c-40db-b769-b93227cec9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:37.338366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31722142-909c-40db-b769-b93227cec9c3 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:37.340255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 356/724] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:37.345907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521749-7395-4b2d-bca1-179eaf1cceb1 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:37.346431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521749-7395-4b2d-bca1-179eaf1cceb1 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:37.346962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521749-7395-4b2d-bca1-179eaf1cceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:37.365595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-12521749-7395-4b2d-bca1-179eaf1cceb1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:37.367131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-12521749-7395-4b2d-bca1-179eaf1cceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:37.439067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 369/725] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:37.564266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50cc6-35b8-44fe-a83c-7ad6bbf4226b None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:37.564944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50cc6-35b8-44fe-a83c-7ad6bbf4226b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:37.565426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50cc6-35b8-44fe-a83c-7ad6bbf4226b None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:37.567233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 357/726] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:37.572833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5503-40b3-4823-b23e-915ee67954d5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:37.573336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5503-40b3-4823-b23e-915ee67954d5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:37.573825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5503-40b3-4823-b23e-915ee67954d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:37.587207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:37.592649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-38ed5503-40b3-4823-b23e-915ee67954d5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:37.593834 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-38ed5503-40b3-4823-b23e-915ee67954d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:37.660520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 370/727] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:37.710306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50cc6-35b8-44fe-a83c-7ad6bbf4226b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:37.755256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:37.815357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50cc6-35b8-44fe-a83c-7ad6bbf4226b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:37.854048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:37.854652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:37.854969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:37.855238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:37.855831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:37.857177 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:37.866284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:37.867255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:37.868093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 358/728] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:37.875375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5503-40b3-4823-b23e-915ee67954d5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:37.938242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:37.992615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5503-40b3-4823-b23e-915ee67954d5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:38.034457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:38.035453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:38.035963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:38.036428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:38.037247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:38.037742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:38.039848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:38.043276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:38.045761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 371/729] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:38.051635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:38.054424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410260f8-40a3-4c0e-b09b-2b375c196346 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:38.079183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:38.091470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:38.092414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:38.092834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:38.093350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:38.094248 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:38.096156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:38.118749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 359/730] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:37 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:15:38.174112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0467d9-7ab6-41c5-8b39-d04db7864b02 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:38.223925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f11e02-22c6-4da9-9503-de989bac6839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:38.224869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11e02-22c6-4da9-9503-de989bac6839 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:38.225318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11e02-22c6-4da9-9503-de989bac6839 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:38.225878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11e02-22c6-4da9-9503-de989bac6839 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:38.226777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f11e02-22c6-4da9-9503-de989bac6839 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:38.227301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f11e02-22c6-4da9-9503-de989bac6839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:38.228974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f11e02-22c6-4da9-9503-de989bac6839 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:38.235450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 372/731] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:38.243552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:38.365270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9549cf0-7de4-43ea-8a99-b61b493d0c11 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:38.393682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44d70-77f6-48cf-bbe1-34d00d047c4d None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:38.393864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44d70-77f6-48cf-bbe1-34d00d047c4d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:38.394132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44d70-77f6-48cf-bbe1-34d00d047c4d None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:38.395487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 373/732] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:38.400821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8808fe3-ff65-4a47-8b67-58baab7175be None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:38.401199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8808fe3-ff65-4a47-8b67-58baab7175be None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:38.401471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8808fe3-ff65-4a47-8b67-58baab7175be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:38.401635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:38.402216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:38.402489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:38.402763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:38.403480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:38.404841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:38.421218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f8808fe3-ff65-4a47-8b67-58baab7175be None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:38.422593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f8808fe3-ff65-4a47-8b67-58baab7175be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:38.428655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 360/733] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:38.487627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:38.515018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 374/734] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:38.774509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:38.798674 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:38.882080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec238-e3fe-439b-8d21-d2b532b48d70 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:38.917925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:38.918544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:38.918837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:38.919109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:38.919836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:38.921278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:38.924013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING keystone.server.flask.common [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 11 13:15:38.945468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.sql.core [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 13:15:38.945468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 13:15:38.945468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [parameters: {'id': 'fc5f986851a64289b325a4997b4e5448', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 11 13:15:38.945468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81401) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc5f986851a64289b325a4997b4e5448.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc5f986851a64289b325a4997b4e5448. Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:15:38.953003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 13:15:38.953780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application yield resource Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise self.value Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application session.commit() Oct 11 13:15:38.954704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.flush() Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application compat.raise_( Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:15:38.955604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 13:15:38.956506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:15:38.957285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [parameters: {'id': 'fc5f986851a64289b325a4997b4e5448', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:38.958139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:38.960242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc5f986851a64289b325a4997b4e5448. Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:38.962369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 361/735] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Oct 11 13:15:38 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:38.963220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8808fe3-ff65-4a47-8b67-58baab7175be None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:39.067032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8808fe3-ff65-4a47-8b67-58baab7175be None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:39.105694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fb0e9-d7a3-49df-95e0-9d97918eea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:39.106810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fb0e9-d7a3-49df-95e0-9d97918eea21 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:39.107314 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fb0e9-d7a3-49df-95e0-9d97918eea21 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:39.107778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fb0e9-d7a3-49df-95e0-9d97918eea21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:39.116743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fb0e9-d7a3-49df-95e0-9d97918eea21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:39.118715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fb0e9-d7a3-49df-95e0-9d97918eea21 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-441fb0e9-d7a3-49df-95e0-9d97918eea21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:39.132395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:39.133329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:39.134183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:39.136882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 375/736] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:39.143045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:39.229550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:39.254916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53269-1ffe-4559-be37-b4e29f8c4b62 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:39.255303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d308-2471-440e-aafc-ecdaeb839a3b None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:39.255778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d308-2471-440e-aafc-ecdaeb839a3b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:39.256265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d308-2471-440e-aafc-ecdaeb839a3b None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:39.259144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 376/737] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:39.267803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda64b-5ab1-4ea9-a8e7-c9d4d5d40545 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:39.268026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda64b-5ab1-4ea9-a8e7-c9d4d5d40545 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:39.268286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda64b-5ab1-4ea9-a8e7-c9d4d5d40545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:39.289977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-0dcda64b-5ab1-4ea9-a8e7-c9d4d5d40545 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:39.291311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0dcda64b-5ab1-4ea9-a8e7-c9d4d5d40545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:39.292564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:39.293497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:39.294119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:39.294388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:39.295075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:39.295413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:39.297099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:39.323169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 362/738] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:39.343416 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:39.374945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 377/739] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:39.641973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:39.746305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251f6d9-485e-4145-9cbf-15f1011f1b63 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:39.781837 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ddda6-e0df-4acb-a673-c5269c99243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:39.782858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ddda6-e0df-4acb-a673-c5269c99243d None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:39.783333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ddda6-e0df-4acb-a673-c5269c99243d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:39.783820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ddda6-e0df-4acb-a673-c5269c99243d None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:39.784671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ddda6-e0df-4acb-a673-c5269c99243d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:39.786220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ddda6-e0df-4acb-a673-c5269c99243d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:39.791459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:39.810709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 363/740] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:39 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:40.405107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044493c1-f611-4f2e-9981-b6d8e1e12f6b None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:40.405626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044493c1-f611-4f2e-9981-b6d8e1e12f6b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:40.405626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044493c1-f611-4f2e-9981-b6d8e1e12f6b None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:40.407245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 378/741] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:40.412439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0294-b78b-4b1b-9e57-de90262ac2fa None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:40.412722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0294-b78b-4b1b-9e57-de90262ac2fa None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:40.412994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0294-b78b-4b1b-9e57-de90262ac2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:40.431987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fbca0294-b78b-4b1b-9e57-de90262ac2fa None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:40.433480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fbca0294-b78b-4b1b-9e57-de90262ac2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:40.507683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 364/742] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:40 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:40.635820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94aa10-563f-4ca3-ba61-b63c2fb569a6 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:40.635996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94aa10-563f-4ca3-ba61-b63c2fb569a6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:40.636269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94aa10-563f-4ca3-ba61-b63c2fb569a6 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:40.637858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 379/743] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:40.643212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efa886-25cc-43c7-adf9-1afb676c9d6f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:40.643676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efa886-25cc-43c7-adf9-1afb676c9d6f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:40.643753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efa886-25cc-43c7-adf9-1afb676c9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:40.662022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-57efa886-25cc-43c7-adf9-1afb676c9d6f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:40.663367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-57efa886-25cc-43c7-adf9-1afb676c9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:40.732090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 365/744] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:40 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:40.774594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94aa10-563f-4ca3-ba61-b63c2fb569a6 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:40.881022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94aa10-563f-4ca3-ba61-b63c2fb569a6 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:40.916514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:40.917068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:40.917340 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:40.917603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:40.918177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:40.919552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:40.928476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:40.929491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:40.930323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 380/745] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:40.937636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efa886-25cc-43c7-adf9-1afb676c9d6f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:40.993849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:40.997059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.046551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:41.047739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efa886-25cc-43c7-adf9-1afb676c9d6f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.089251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.090701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.091202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.091668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.092997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:41.093602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.095275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.106261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 366/746] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:41.108847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.122656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df53219-d5ee-49cf-b8fa-7790f08317fb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.163183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.164614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.165097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.165560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.166332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.168199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:41.178130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:41.179328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:41.180305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:41.182717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 381/747] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:41.189289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.229053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9d7e-90e0-41ef-9c3b-f7b8ce8a4f33 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.246758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:41.267917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.268903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.269374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.269892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.270758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:41.271277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.273058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.284558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 367/748] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:41.285061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.315996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fddb2-3227-4f16-8edc-0cc3f08143e5 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.319138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:41.357460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.358533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.359065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.359529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.360346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:41.360886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.362552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.368852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 382/749] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:41.376105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.421986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01372-8eda-485e-a5fd-32a43b805581 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.463902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.465347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.465851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.466712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.467921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] RBAC: Adding query filter params (interface=public, service_id=c27348caf90a4f369434e37d14aa2240, region_id=RegionOne) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:41.468428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.470215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.481930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 368/750] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:15:41 2022] GET /identity/v3/endpoints?service_id=c27348caf90a4f369434e37d14aa2240&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:41.482746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.494891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968cf9e-748e-4207-865f-f67e7e390e82 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.529411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998841f1-2457-4f10-8324-1d4d52213fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.530021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998841f1-2457-4f10-8324-1d4d52213fac None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.530296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998841f1-2457-4f10-8324-1d4d52213fac None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.530564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998841f1-2457-4f10-8324-1d4d52213fac None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.531213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998841f1-2457-4f10-8324-1d4d52213fac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:41.531514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998841f1-2457-4f10-8324-1d4d52213fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.533058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998841f1-2457-4f10-8324-1d4d52213fac None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.537908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:41.544468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 383/751] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:41.544468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e69de-7cc7-40ff-bba6-304cda5920cc None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.544468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e69de-7cc7-40ff-bba6-304cda5920cc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.544468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e69de-7cc7-40ff-bba6-304cda5920cc None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.544468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 384/752] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:41.545467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e69de-7cc7-40ff-bba6-304cda5920cc None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.577442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:41.601878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2dad-0c1e-40f7-b077-74f15d2f2c54 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.639905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ce523-724e-46f3-9657-a387cc379768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.640523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ce523-724e-46f3-9657-a387cc379768 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.640798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ce523-724e-46f3-9657-a387cc379768 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.641063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ce523-724e-46f3-9657-a387cc379768 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.641663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ce523-724e-46f3-9657-a387cc379768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.643061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ce523-724e-46f3-9657-a387cc379768 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.648969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e69de-7cc7-40ff-bba6-304cda5920cc None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.655027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 369/753] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:41 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:15:41.655027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d11a80-7281-40a0-9a23-a6af66cad089 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.655027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d11a80-7281-40a0-9a23-a6af66cad089 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.655027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d11a80-7281-40a0-9a23-a6af66cad089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.677254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-32d11a80-7281-40a0-9a23-a6af66cad089 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:41.678381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-32d11a80-7281-40a0-9a23-a6af66cad089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:41.700892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.701978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.702450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.703034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.703862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] RBAC: Adding query filter params (interface=admin, service_id=53caa140eaf647178884ab4b61a53a3e, region_id=RegionOne) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:41.704270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.705789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.716601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 385/754] 10.222.0.16 () {56 vars in 1249 bytes} [Tue Oct 11 13:15:41 2022] GET /identity/v3/endpoints?service_id=53caa140eaf647178884ab4b61a53a3e&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:41.718077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:41.764427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 370/755] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:41 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:41.841043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:41.847581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3951a9-f749-4fda-a5bb-6483eb43e391 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:41.885766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242353-057e-46a1-b6bb-baaf06d7326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:41.886731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242353-057e-46a1-b6bb-baaf06d7326d None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:41.887038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242353-057e-46a1-b6bb-baaf06d7326d None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:41.887306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242353-057e-46a1-b6bb-baaf06d7326d None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:41.887908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242353-057e-46a1-b6bb-baaf06d7326d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:41.889301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242353-057e-46a1-b6bb-baaf06d7326d None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:41.896205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 386/756] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:41 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:15:42.045084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8669b-43a1-4204-b337-3f99b74b5c64 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.045434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8669b-43a1-4204-b337-3f99b74b5c64 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.045633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8669b-43a1-4204-b337-3f99b74b5c64 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.047302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 371/757] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:42.053157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c235a-2e24-4d47-a809-848e33811fdd None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.053442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c235a-2e24-4d47-a809-848e33811fdd None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.053733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c235a-2e24-4d47-a809-848e33811fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.061146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8669b-43a1-4204-b337-3f99b74b5c64 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:42.072814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7c4c235a-2e24-4d47-a809-848e33811fdd None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:42.074081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7c4c235a-2e24-4d47-a809-848e33811fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:42.114517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:42.151004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 387/758] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:42 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:42.189125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8669b-43a1-4204-b337-3f99b74b5c64 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:42.225689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:42.226664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.227255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.227769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.228666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:42.230296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:42.246470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.sql.core [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 13:15:42.246470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 11 13:15:42.246470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [parameters: {'user_id': 'b74f7b7e14ae485e86b6b66d343ad571', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 11 13:15:42.246470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81401) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:15:42.255388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:15:42.256250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application yield resource Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise self.value Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application session.commit() Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 13:15:42.257349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.flush() Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application compat.raise_( Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:15:42.258332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:15:42.259926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:15:42.260728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b74f7b7e14ae485e86b6b66d343ad571', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:42.261529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 11 13:15:42.262370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 11 13:15:42.264600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 11 13:15:42.264600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 11 13:15:42.264600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 13:15:42.264600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 13:15:42.264600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 11 13:15:42.264600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.267024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 372/759] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Oct 11 13:15:42 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:42.274897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c235a-2e24-4d47-a809-848e33811fdd None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:42.371679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:42.382151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c235a-2e24-4d47-a809-848e33811fdd None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:42.417992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:42.418464 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:42.419058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.419495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.419895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.427952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:42.429831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:42.443106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:42.444282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 13:15:42.445447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:42.452362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 388/760] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:42.453845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:42.521989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:42.526282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3405e4-1043-4a6d-bb93-0b81066f0daf None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:42.571535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:42.572542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.573007 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.573514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] PATH_INFO: `/v3/services/image` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.574461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:42.576813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:42.580252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2170d70-7e90-4c9b-b89e-be292efd796a None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:42.587637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:42.588605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:42.589420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:42.593755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 373/761] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Oct 11 13:15:42 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:42.594667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:42.634953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:42.635941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.636476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.636965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.637859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:42.638345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:42.640004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:42.682878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 389/762] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Oct 11 13:15:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:42.714005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffc417-a21c-4c65-983e-b7ee73b5cddd None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:42.751921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:42.752841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.753254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.753687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.754460 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] RBAC: Adding query filter params (name=image) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:42.754920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:42.756564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:42.765881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 374/763] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:42.771909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:42.784780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:42.891163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e1da2-b244-441c-9183-c96dc1ae78fc None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:42.928317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:42.929471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:42.929972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:42.930430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:42.931486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] RBAC: Adding query filter params (type=image) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:42.931980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:42.933582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:42.939408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 390/764] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:42.944860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:42.980956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:43.053267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec563-b746-4c09-9b76-d736b9860151 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:43.087901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d565c16-b1a4-4343-a2d5-b1e7e298f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:43.088504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565c16-b1a4-4343-a2d5-b1e7e298f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:43.088772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565c16-b1a4-4343-a2d5-b1e7e298f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:43.089031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565c16-b1a4-4343-a2d5-b1e7e298f4f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:43.089723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d565c16-b1a4-4343-a2d5-b1e7e298f4f7 None admin] RBAC: Adding query filter params (interface=public, service_id=9ce59d793c31429d960ecf6470a26a81, region_id=RegionOne) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:43.090022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d565c16-b1a4-4343-a2d5-b1e7e298f4f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:43.091394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d565c16-b1a4-4343-a2d5-b1e7e298f4f7 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:43.096682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 375/765] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:15:42 2022] GET /identity/v3/endpoints?service_id=9ce59d793c31429d960ecf6470a26a81&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:43.102323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:43.175060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:43.206063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e02457-c103-4860-957c-fe3a9ae0f83a None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:43.240384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee914b6-5752-45b1-bba5-8f335e537410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:43.241123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee914b6-5752-45b1-bba5-8f335e537410 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:43.241522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee914b6-5752-45b1-bba5-8f335e537410 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:43.241881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee914b6-5752-45b1-bba5-8f335e537410 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:43.242577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee914b6-5752-45b1-bba5-8f335e537410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:43.244094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee914b6-5752-45b1-bba5-8f335e537410 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:43.258918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 391/766] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:15:43 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:15:43.871832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eaaa-1874-42df-ac87-e738c3941ac9 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:43.872416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eaaa-1874-42df-ac87-e738c3941ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:43.872416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eaaa-1874-42df-ac87-e738c3941ac9 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:43.873851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 376/767] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:43.879022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105271ab-091c-4ca2-9257-9a994b4f5254 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:43.879431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105271ab-091c-4ca2-9257-9a994b4f5254 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:43.879602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105271ab-091c-4ca2-9257-9a994b4f5254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:43.898503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-105271ab-091c-4ca2-9257-9a994b4f5254 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:43.899745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-105271ab-091c-4ca2-9257-9a994b4f5254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:43.968736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 392/768] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:43 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:44.133443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8539a-d541-4a0b-a8e5-3d0225f9ad7b None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.133628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8539a-d541-4a0b-a8e5-3d0225f9ad7b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.133914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8539a-d541-4a0b-a8e5-3d0225f9ad7b None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.135402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 377/769] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:44.140943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9665c8-dfff-417a-b05b-953d3c064623 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.141227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9665c8-dfff-417a-b05b-953d3c064623 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.141495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9665c8-dfff-417a-b05b-953d3c064623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.160055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3e9665c8-dfff-417a-b05b-953d3c064623 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:44.161209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3e9665c8-dfff-417a-b05b-953d3c064623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:44.220777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:44.229554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 393/770] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:44 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:44.234767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8539a-d541-4a0b-a8e5-3d0225f9ad7b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:44.330695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:44.345733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8539a-d541-4a0b-a8e5-3d0225f9ad7b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:44.380064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:44.380710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.380980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.381243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.381823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:44.383210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:44.392233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:44.395044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:44.395945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 378/771] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:44.399304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9665c8-dfff-417a-b05b-953d3c064623 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:44.498350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9665c8-dfff-417a-b05b-953d3c064623 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:44.504962 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:44.537981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22564add-312f-470e-9062-af919b6511c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:44.539354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564add-312f-470e-9062-af919b6511c9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.539633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564add-312f-470e-9062-af919b6511c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.539900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564add-312f-470e-9062-af919b6511c9 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.540523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22564add-312f-470e-9062-af919b6511c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:44.540826 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22564add-312f-470e-9062-af919b6511c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:44.542196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22564add-312f-470e-9062-af919b6511c9 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:44.547165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 394/772] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:44.552654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22564add-312f-470e-9062-af919b6511c9 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:44.609725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:44.617398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce354542-c03b-4b0a-a417-7d2ef3c2dc27 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:44.652028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22564add-312f-470e-9062-af919b6511c9 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:44.657709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:44.658342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.658617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.658913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.659710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:44.660857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:44.669882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:44.670994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:44.671828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 379/773] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Oct 11 13:15:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:44.677175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:44.691821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:44.692426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.692700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.692964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.693589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:44.693884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:44.695379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:44.699964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:44.705408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 395/774] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Oct 11 13:15:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:44.706121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:44.783191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a93e1-93f6-4fd4-8169-7ec1511ca524 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:44.809183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b432fe-b997-4e00-969e-159c004412b7 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:44.817716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:44.818642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.818642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.818963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.819662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:44.820049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:44.821438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:44.826332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 380/775] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:44.832040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:44.834705 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:44.846857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:44.847788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.847920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.848110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.848773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:44.850278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:44.878859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 396/776] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:44.929527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:44.947198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713383-5dc7-45a8-86e4-58696c831eac None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:44.991780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc7894-df13-40bf-90d5-85792b008b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:44.992395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7894-df13-40bf-90d5-85792b008b31 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:44.992661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7894-df13-40bf-90d5-85792b008b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:44.992938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7894-df13-40bf-90d5-85792b008b31 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:44.993569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc7894-df13-40bf-90d5-85792b008b31 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:44.993863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc7894-df13-40bf-90d5-85792b008b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:44.995267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc7894-df13-40bf-90d5-85792b008b31 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:45.005521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 381/777] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Oct 11 13:15:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:45.007360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:45.118457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba826-8008-4897-ae80-1791be1e8fbb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:45.152954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9500a-c51a-45b3-a22e-17a27f247dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:45.153612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9500a-c51a-45b3-a22e-17a27f247dd0 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:45.153890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9500a-c51a-45b3-a22e-17a27f247dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:45.154151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9500a-c51a-45b3-a22e-17a27f247dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:45.154805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9500a-c51a-45b3-a22e-17a27f247dd0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:45.156207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9500a-c51a-45b3-a22e-17a27f247dd0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:45.173705 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 397/778] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:45.385747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6520fc1-0edf-483f-a057-6405ef9eb56a None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:45.386024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6520fc1-0edf-483f-a057-6405ef9eb56a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:45.386293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6520fc1-0edf-483f-a057-6405ef9eb56a None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:45.387855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 382/779] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:45.393364 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79310-2703-42a1-8478-5eccfc4beea7 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:45.393647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79310-2703-42a1-8478-5eccfc4beea7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:45.393915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79310-2703-42a1-8478-5eccfc4beea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:45.413484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-27b79310-2703-42a1-8478-5eccfc4beea7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:45.415022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-27b79310-2703-42a1-8478-5eccfc4beea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:45.451546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:45.494477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 398/780] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:45.756679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6520fc1-0edf-483f-a057-6405ef9eb56a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:45.865296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6520fc1-0edf-483f-a057-6405ef9eb56a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:45.899035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:45.899670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:45.899945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:45.900213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:45.900793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:45.902151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:45.911212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:45.912221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 13:15:45.913067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:45.917807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 383/781] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Oct 11 13:15:45 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:45.918665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79310-2703-42a1-8478-5eccfc4beea7 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:46.020276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79310-2703-42a1-8478-5eccfc4beea7 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:46.053927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:46.054541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:46.054836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:46.055117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:46.055747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:46.056049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:46.057437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:46.062996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 399/782] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:46.068738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:46.081074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:46.172679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca055-25af-42c5-be03-e30cbc3be2d5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:46.208078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e30d0d-8a3b-45bf-954f-b35b4765f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:46.208690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30d0d-8a3b-45bf-954f-b35b4765f8be None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:46.208969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30d0d-8a3b-45bf-954f-b35b4765f8be None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:46.209236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30d0d-8a3b-45bf-954f-b35b4765f8be None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:46.209864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30d0d-8a3b-45bf-954f-b35b4765f8be None admin] RBAC: Adding query filter params (type=image) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:46.210283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30d0d-8a3b-45bf-954f-b35b4765f8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:46.211673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30d0d-8a3b-45bf-954f-b35b4765f8be None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:46.216780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 384/783] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:46.222339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:46.253478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:46.326753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90344d9c-0ffb-4d72-8393-ac3d64c8cbc7 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:46.363259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a533eb-eb04-4f8b-b701-0a546142055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:46.363877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a533eb-eb04-4f8b-b701-0a546142055a None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:46.364156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a533eb-eb04-4f8b-b701-0a546142055a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:46.364430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a533eb-eb04-4f8b-b701-0a546142055a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:46.365105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a533eb-eb04-4f8b-b701-0a546142055a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:46.366539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a533eb-eb04-4f8b-b701-0a546142055a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:46.388068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 400/784] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:15:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:47.076650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e956-997b-4e8a-852c-670a4a749598 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.077171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e956-997b-4e8a-852c-670a4a749598 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.077171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e956-997b-4e8a-852c-670a4a749598 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.078649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 385/785] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:47.083745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929759-d068-43e5-b993-0bd6940154df None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.084170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929759-d068-43e5-b993-0bd6940154df None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.084312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929759-d068-43e5-b993-0bd6940154df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.102850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-87929759-d068-43e5-b993-0bd6940154df None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:47.104034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-87929759-d068-43e5-b993-0bd6940154df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:47.178797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 401/786] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:47.335709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809d36-66c3-49ae-a79e-4975a88766f4 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.335882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809d36-66c3-49ae-a79e-4975a88766f4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.336149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809d36-66c3-49ae-a79e-4975a88766f4 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.337876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 386/787] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:47.343103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d870de-e3fa-4b7f-8df2-e854110a8f13 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.343387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d870de-e3fa-4b7f-8df2-e854110a8f13 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.343653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d870de-e3fa-4b7f-8df2-e854110a8f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.362204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-18d870de-e3fa-4b7f-8df2-e854110a8f13 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:47.363400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-18d870de-e3fa-4b7f-8df2-e854110a8f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:47.370853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:47.431078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 402/788] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:47.442018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809d36-66c3-49ae-a79e-4975a88766f4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:47.515065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:47.546267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809d36-66c3-49ae-a79e-4975a88766f4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:47.580137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:47.580761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.581032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.581255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.592046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:47.596766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:47.597647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:47.598465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:47.603119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 387/789] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Oct 11 13:15:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:47.604246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d870de-e3fa-4b7f-8df2-e854110a8f13 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:47.690810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:47.707535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d870de-e3fa-4b7f-8df2-e854110a8f13 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:47.745583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:47.746181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.746450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.746710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.747400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:47.747996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:47.749051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:47.757781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 403/790] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Oct 11 13:15:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:47.763141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:47.766753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:47.798606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6f894-71fc-413f-a982-701f55c9ba8e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:47.830638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:47.836495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:47.837122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.837393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.837677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.838764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:47.840213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:47.841763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 388/791] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:47.847449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:47.871849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf563355-0bdd-4169-92af-91f0231033d3 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:47.913460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:47.914469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.914743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.915583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.925586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:47.927110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:47.945247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:47.946197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:47.947094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:47.947094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:47.947094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:47.947258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59666ea1-ab77-4ab9-8554-913f5cbb701b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:47.948420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 404/792] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:47.953964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:47.982559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:47.983195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:47.983468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:47.983733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:47.984373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:47.985790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:48.013913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:48.015806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 389/793] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:15:47 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:15:48.070984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39025-d47e-4794-9592-55a7c53a9848 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:48.109863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:48.110520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:48.110808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:48.110943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:48.111604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:48.111905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:48.113309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:48.131812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 405/794] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:48.133161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:48.194036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:48.245701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e05e1-0ff2-4e10-8c63-89e1f2a4fadf None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:48.279618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:48.280351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:48.280627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:48.280890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] PATH_INFO: `/v3/users/nova` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:48.289104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:48.290519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:48.301834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:48.302778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:48.304067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 390/795] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Oct 11 13:15:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:48.310533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:48.419452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c285ef8-cb51-4d62-ad9d-f368858810ea None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:48.438087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:48.459147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12949f75-123f-411c-945c-6ee5236effcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:48.459769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12949f75-123f-411c-945c-6ee5236effcc None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:48.460165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12949f75-123f-411c-945c-6ee5236effcc None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:48.460435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12949f75-123f-411c-945c-6ee5236effcc None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:48.461172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12949f75-123f-411c-945c-6ee5236effcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:48.461474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12949f75-123f-411c-945c-6ee5236effcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:48.462951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12949f75-123f-411c-945c-6ee5236effcc None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:48.481550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 406/796] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Oct 11 13:15:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:48.487282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:48.549917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af71f7-c075-4ce2-9572-3e973659a3e3 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:48.550198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af71f7-c075-4ce2-9572-3e973659a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:48.550475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af71f7-c075-4ce2-9572-3e973659a3e3 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:48.552134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 407/797] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:48.556909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf046-ca16-45ef-ad05-dfbc18636481 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:48.557187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf046-ca16-45ef-ad05-dfbc18636481 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:48.557453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf046-ca16-45ef-ad05-dfbc18636481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:48.579396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d35cf046-ca16-45ef-ad05-dfbc18636481 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:48.580861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d35cf046-ca16-45ef-ad05-dfbc18636481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:48.594446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc642e-ee83-4ef0-aee4-795a1416bece None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:48.608507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:48.630976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:48.631592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:48.632047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:48.632262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:48.643287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:48.644718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:48.657603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 408/798] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:48.658471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:48.664808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:48.665728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:48.665728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:48.665728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:48.665728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 391/799] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:48.665962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf046-ca16-45ef-ad05-dfbc18636481 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:48.885288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf046-ca16-45ef-ad05-dfbc18636481 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:48.888515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:48.921374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:48.921990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:48.922161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:48.922261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:48.922517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:48.923190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:48.923485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:48.924846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:48.943008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 409/800] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:48.944587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:49.035414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc73a7-bf3d-45a2-b439-1bb97f658d3d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:49.045461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618cd40-30cb-4a69-91b5-7a00a8263347 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:49.077695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:49.078305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:49.078569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:49.078849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:49.079529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:49.080394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:49.080902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:49.081318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:49.081740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:49.082141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:49.089301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.sql.core [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 13:15:49.089301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 13:15:49.089301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [parameters: {'id': '639d132c13484b169fbb8c901702f3a2', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 13:15:49.089301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81401) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 13:15:49.089809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:49.091532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:15:49.097296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 13:15:49.098237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application yield resource Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application next(self.gen) Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise self.value Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application session.commit() Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 13:15:49.099200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.session.flush() Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application compat.raise_( Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 13:15:49.100064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:15:49.100949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application conn.query(q) Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application result.read() Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 13:15:49.101689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [parameters: {'id': '639d132c13484b169fbb8c901702f3a2', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 13:15:49.102558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:49.103417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.104390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 392/801] 10.222.0.16 () {60 vars in 1137 bytes} [Tue Oct 11 13:15:48 2022] POST /identity/v3/domains => generated 190 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:49.105169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:49.111328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:49.117442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 410/802] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:49.118356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:49.138282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:49.145651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:49.221120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198df630-6290-40a3-a41d-bba59b7e561c None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:49.224579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3877-98eb-4a29-99d0-5361fdcacb36 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:49.254671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:49.255351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:49.255628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:49.255896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:49.261634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:49.262244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:49.262519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:49.262934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:49.263617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:49.263918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:49.265506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:49.266630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:49.268094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:49.282749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:49.283746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:49.284606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:49.284606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:49.284606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:49.284804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 411/803] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:49.284804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:49.287137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 393/804] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:49.290293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:49.379340 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:49.381176 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:49.398399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad19d-6a47-4347-b161-942334a528cf None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:49.400494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8d54-358e-4e4f-ba2e-cb79dc1a5f64 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:49.434005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447fb76-bce3-40e5-a064-c8e8d6281474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:49.434515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa1a8d-e098-4149-89ff-39fafb06c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:49.434654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fb76-bce3-40e5-a064-c8e8d6281474 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:49.434957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fb76-bce3-40e5-a064-c8e8d6281474 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:49.435153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa1a8d-e098-4149-89ff-39fafb06c16b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:49.435247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fb76-bce3-40e5-a064-c8e8d6281474 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/c81304f420a447a1a488a941d4075513/roles/57552e48d4024cd5af71ab0b13705f51` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:49.435430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa1a8d-e098-4149-89ff-39fafb06c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:49.435732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa1a8d-e098-4149-89ff-39fafb06c16b None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:49.436328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa1a8d-e098-4149-89ff-39fafb06c16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:49.436626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa1a8d-e098-4149-89ff-39fafb06c16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:49.437472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447fb76-bce3-40e5-a064-c8e8d6281474 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=c81304f420a447a1a488a941d4075513, role_id=57552e48d4024cd5af71ab0b13705f51)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:49.437980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa1a8d-e098-4149-89ff-39fafb06c16b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:49.438922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447fb76-bce3-40e5-a064-c8e8d6281474 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:49.449998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 394/805] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:49.458758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 412/806] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:15:49 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/c81304f420a447a1a488a941d4075513/roles/57552e48d4024cd5af71ab0b13705f51 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:15:50.193391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e9a5-4979-4c2e-9ded-25d81b06ccaf None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:50.193946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e9a5-4979-4c2e-9ded-25d81b06ccaf None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:50.193946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e9a5-4979-4c2e-9ded-25d81b06ccaf None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:50.195601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 395/807] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:50.201163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ff42-5148-4c49-ba4d-480ff238609b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:50.201553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ff42-5148-4c49-ba4d-480ff238609b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:50.201736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ff42-5148-4c49-ba4d-480ff238609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:50.220809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2ba9ff42-5148-4c49-ba4d-480ff238609b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:50.221999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2ba9ff42-5148-4c49-ba4d-480ff238609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:50.292057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 413/808] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:50.561241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187e9a5-4979-4c2e-9ded-25d81b06ccaf None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:50.665925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187e9a5-4979-4c2e-9ded-25d81b06ccaf None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:50.701414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71696e-613f-4259-8499-d56516dc6c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:50.702046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71696e-613f-4259-8499-d56516dc6c40 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:50.702324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71696e-613f-4259-8499-d56516dc6c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:50.702591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71696e-613f-4259-8499-d56516dc6c40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:50.703784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71696e-613f-4259-8499-d56516dc6c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:50.705217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71696e-613f-4259-8499-d56516dc6c40 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:50.706806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 396/809] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:50.713053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ff42-5148-4c49-ba4d-480ff238609b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:50.788678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:50.814863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ff42-5148-4c49-ba4d-480ff238609b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:50.850253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a444-77c7-44f1-9ec0-128376f07987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:50.851097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a444-77c7-44f1-9ec0-128376f07987 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:50.851442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a444-77c7-44f1-9ec0-128376f07987 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:50.851709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a444-77c7-44f1-9ec0-128376f07987 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:50.852384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a444-77c7-44f1-9ec0-128376f07987 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:50.853814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a444-77c7-44f1-9ec0-128376f07987 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:50.876541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 414/810] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:15:50 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:15:51.574855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742e50-d666-4957-8e35-ceea91708dcd None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:51.575409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742e50-d666-4957-8e35-ceea91708dcd None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:51.575409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742e50-d666-4957-8e35-ceea91708dcd None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:51.576743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 397/811] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:51.582017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c846-adc5-47d2-b662-24541d4d23f5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:51.582446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c846-adc5-47d2-b662-24541d4d23f5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:51.582534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c846-adc5-47d2-b662-24541d4d23f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:51.601155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-fc28c846-adc5-47d2-b662-24541d4d23f5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:51.602240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fc28c846-adc5-47d2-b662-24541d4d23f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:51.670297 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 415/812] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:51.930104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742e50-d666-4957-8e35-ceea91708dcd None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:51.941897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:52.033235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742e50-d666-4957-8e35-ceea91708dcd None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:52.067668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:52.068294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:52.068562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:52.068825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:52.079139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:52.083860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:52.084784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 13:15:52.085689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:52.087252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 398/813] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Oct 11 13:15:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:52.090951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28c846-adc5-47d2-b662-24541d4d23f5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:52.149821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:52.191783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28c846-adc5-47d2-b662-24541d4d23f5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:52.224665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:52.225269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:52.225586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:52.225849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:52.226508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:52.226800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:52.228173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:52.235867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 416/814] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Oct 11 13:15:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:52.241848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:52.311065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:52.350918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce75e5b-9473-4966-85c4-10422314d56e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:52.385885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:52.386510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:52.386785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:52.387082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:52.397077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:52.398749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:52.413672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:52.415103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:52.416316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:52.416316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:52.416316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:52.416316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 399/815] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:52.421042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:52.523378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce4926-a135-40eb-b1dc-a88312787039 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:52.546440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:52.559491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:52.560100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:52.560375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:52.560638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:52.561268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:52.561560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:52.562958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:52.575492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 417/816] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:52.581237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:52.686529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afaa31-829c-44b8-af0a-6709b9ea5c48 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:52.706131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:52.720686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:52.721313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:52.721591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:52.721860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:52.729399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:52.730839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:15:52.741989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:52.742938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:52.743893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 400/817] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Oct 11 13:15:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:52.749220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:52.850540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950861-f7dd-45d6-b88b-9d836b3400f6 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:52.886296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a945-6638-48c7-a679-c211ad5cece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:52.886926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a945-6638-48c7-a679-c211ad5cece0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:52.887234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a945-6638-48c7-a679-c211ad5cece0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:52.887502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a945-6638-48c7-a679-c211ad5cece0 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:52.888249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a945-6638-48c7-a679-c211ad5cece0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:52.888553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a945-6638-48c7-a679-c211ad5cece0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:52.890027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a945-6638-48c7-a679-c211ad5cece0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:52.910425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 418/818] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Oct 11 13:15:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:52.917023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.002599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bc115-a3ed-4403-bd33-5a45c7fff59e None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.002864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bc115-a3ed-4403-bd33-5a45c7fff59e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.003164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bc115-a3ed-4403-bd33-5a45c7fff59e None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.004756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 419/819] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:15:53.009568 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205e5e-6c7b-4c48-943b-695c9f5ee579 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.009839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205e5e-6c7b-4c48-943b-695c9f5ee579 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.010108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205e5e-6c7b-4c48-943b-695c9f5ee579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.021841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d317e-9f7d-4841-8ea3-25bf35497653 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.028361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-32205e5e-6c7b-4c48-943b-695c9f5ee579 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:53.029540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-32205e5e-6c7b-4c48-943b-695c9f5ee579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:53.055600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.056205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.056479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.056748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.063844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.096021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 420/820] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:15:53.103420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.123960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.125410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.221958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 401/821] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:15:53.228038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32205e5e-6c7b-4c48-943b-695c9f5ee579 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.325886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32205e5e-6c7b-4c48-943b-695c9f5ee579 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.359730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.360177 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.360280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.360557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.360824 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.376371 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.377860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:15:53.393172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:53.394177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:15:53.395167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:15:53.395167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:15:53.395167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:53.395167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 421/822] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:53.401066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.425140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.452043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.472929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c26e3d-d66a-4c45-806b-5f70de29c670 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.501461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522631d-f9e2-493c-b93b-4870d8b12b15 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.509877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.510512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.510789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.511087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.521229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:53.526165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:53.527416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:15:53.528591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 402/823] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:15:53.533621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.537910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.538545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.539154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.539424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.540067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:53.540367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.541736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.553255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 422/824] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:53.559245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.631655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38d3c5-77f6-41b8-9f79-f958a1778d50 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.637990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.656528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c501e82-d811-46d3-9af9-ff810ab17b10 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.666415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.667063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.667316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.667626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.668250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:53.668551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.669930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.678659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 403/825] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:53.684717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.687394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.691618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.692330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.692605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.692864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.699857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.701312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:15:53.712839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:53.713759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:53.715088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 423/826] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:53.719726 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.787690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bf837-6f0c-45d0-9fcc-81a783c48fde None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.817903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf082-9472-4285-9b93-67b0387464a7 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.825065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.826082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.826361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.826626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] PATH_INFO: `/v3/users/da89814ca06044389abd097cc170d8d1` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.841401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] RBAC: Authorizing `identity:get_user(user_id=da89814ca06044389abd097cc170d8d1)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.842841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.844496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 404/827] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/users/da89814ca06044389abd097cc170d8d1 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:53.850349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.854036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.854643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.854962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.855233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.855920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:53.856223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.857647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.870217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 424/828] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:53.876178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:53.878811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.912171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:53.954102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875c258-e8bc-42ee-b417-68e13daee048 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.974873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40528058-9b83-417b-a513-e2a70a4f5555 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:53.986098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:53.986719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:53.987020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:53.987286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] PATH_INFO: `/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:53.988384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] RBAC: Authorizing `identity:get_project(project_id=a400b3c6a03b4439b5ea081ba436e2d7)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:53.989789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:53.991580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 405/829] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:53.997553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:54.009705 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20823c14-eecb-4d03-99c8-45f3ff70e99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:54.010308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20823c14-eecb-4d03-99c8-45f3ff70e99a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:54.010583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20823c14-eecb-4d03-99c8-45f3ff70e99a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:54.010875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20823c14-eecb-4d03-99c8-45f3ff70e99a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:54.011599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20823c14-eecb-4d03-99c8-45f3ff70e99a None admin] RBAC: Adding query filter params (role.id=57552e48d4024cd5af71ab0b13705f51, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=c81304f420a447a1a488a941d4075513) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:54.011901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20823c14-eecb-4d03-99c8-45f3ff70e99a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:54.013333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20823c14-eecb-4d03-99c8-45f3ff70e99a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:54.019052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 425/830] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:53 2022] GET /identity/v3/role_assignments?user.id=c81304f420a447a1a488a941d4075513&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=57552e48d4024cd5af71ab0b13705f51 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:54.102598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf3d2-e7d3-4229-9557-8bbf173f1723 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:54.131516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:54.140818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953e9f0-e071-4540-9004-d0fe4cc3bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:54.141515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953e9f0-e071-4540-9004-d0fe4cc3bc81 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:54.141791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953e9f0-e071-4540-9004-d0fe4cc3bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:54.142063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953e9f0-e071-4540-9004-d0fe4cc3bc81 None admin] PATH_INFO: `/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7/users/da89814ca06044389abd097cc170d8d1/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:54.144183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953e9f0-e071-4540-9004-d0fe4cc3bc81 None admin] RBAC: Authorizing `identity:create_grant(project_id=a400b3c6a03b4439b5ea081ba436e2d7, user_id=da89814ca06044389abd097cc170d8d1, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:54.145657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953e9f0-e071-4540-9004-d0fe4cc3bc81 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:54.160919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 406/831] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:15:53 2022] PUT /identity/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7/users/da89814ca06044389abd097cc170d8d1/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:15:56.283246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b9c0-9b76-4e22-af31-08bd4ce5b56b None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:56.284569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b9c0-9b76-4e22-af31-08bd4ce5b56b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:56.284992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b9c0-9b76-4e22-af31-08bd4ce5b56b None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:56.287377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 426/832] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:56.295607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ae0d-ae17-4b02-aff2-03c65d6a6732 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:56.296082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ae0d-ae17-4b02-aff2-03c65d6a6732 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:56.296082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ae0d-ae17-4b02-aff2-03c65d6a6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:56.317247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cba6ae0d-ae17-4b02-aff2-03c65d6a6732 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:56.320563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cba6ae0d-ae17-4b02-aff2-03c65d6a6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:15:56.393839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 407/833] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:15:56.676553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b9c0-9b76-4e22-af31-08bd4ce5b56b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:56.756640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:56.805589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b9c0-9b76-4e22-af31-08bd4ce5b56b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:56.840431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:56.841041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:56.841313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:56.841578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:56.852350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:15:56.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:15:56.858133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:15:56.859000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 427/834] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:15:56.864559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6ae0d-ae17-4b02-aff2-03c65d6a6732 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:56.964914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6ae0d-ae17-4b02-aff2-03c65d6a6732 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:56.982892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:57.000751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:57.001346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:57.001614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:57.001878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:57.002523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:57.002835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:57.004199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:57.012223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 408/835] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:15:57.018460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:57.132903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bdb74-2a50-4b57-9025-499695a5afea None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:57.159384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:57.169596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:57.170205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:57.170474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:57.170738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] PATH_INFO: `/v3/users/da89814ca06044389abd097cc170d8d1` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:57.171925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] RBAC: Authorizing `identity:get_user(user_id=da89814ca06044389abd097cc170d8d1)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:57.173348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:57.174932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 428/836] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:15:57 2022] GET /identity/v3/users/da89814ca06044389abd097cc170d8d1 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:57.180988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:57.296948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268f46b-e619-48cb-8909-be85fdbc0e58 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:57.332251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:57.332857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:57.333163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:57.333422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:57.389885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:57.411654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:57.413164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:57.511489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 409/837] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:15:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:15:57.517775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:57.621001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e5c7-481a-4c34-aad6-7bc0a93a34bc None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:57.659403 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045952d5-83a2-4823-a9a7-a76f364fe252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:57.660355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045952d5-83a2-4823-a9a7-a76f364fe252 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:57.660790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045952d5-83a2-4823-a9a7-a76f364fe252 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:57.661183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045952d5-83a2-4823-a9a7-a76f364fe252 None admin] PATH_INFO: `/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:57.663201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045952d5-83a2-4823-a9a7-a76f364fe252 None admin] RBAC: Authorizing `identity:get_project(project_id=a400b3c6a03b4439b5ea081ba436e2d7)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:57.665812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045952d5-83a2-4823-a9a7-a76f364fe252 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:57.668423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 429/838] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:15:57 2022] GET /identity/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:57.675598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:15:57.764153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:15:57.784632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0888-f4b5-4fa9-a630-3b22f2b308e5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:15:57.819374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216b7a-050d-4b06-8af6-aeefbcf8cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:15:57.819964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216b7a-050d-4b06-8af6-aeefbcf8cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:57.820236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216b7a-050d-4b06-8af6-aeefbcf8cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:57.820507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216b7a-050d-4b06-8af6-aeefbcf8cfd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:57.821228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216b7a-050d-4b06-8af6-aeefbcf8cfd1 None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=a400b3c6a03b4439b5ea081ba436e2d7, user.id=da89814ca06044389abd097cc170d8d1) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:15:57.821533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216b7a-050d-4b06-8af6-aeefbcf8cfd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:15:57.823002 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216b7a-050d-4b06-8af6-aeefbcf8cfd1 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:15:57.828823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 410/839] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:15:57 2022] GET /identity/v3/role_assignments?user.id=da89814ca06044389abd097cc170d8d1&scope.project.id=a400b3c6a03b4439b5ea081ba436e2d7&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:15:59.943276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178be91c-796b-4d35-b1e3-0c036706b5b6 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:59.944108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178be91c-796b-4d35-b1e3-0c036706b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:59.944108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178be91c-796b-4d35-b1e3-0c036706b5b6 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:59.946216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 430/840] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:15:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:15:59.951710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3bb56-d4d4-4263-9cba-0f705607edef None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:15:59.952118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3bb56-d4d4-4263-9cba-0f705607edef None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:15:59.952234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3bb56-d4d4-4263-9cba-0f705607edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:15:59.971072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-ddc3bb56-d4d4-4263-9cba-0f705607edef None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:15:59.972239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ddc3bb56-d4d4-4263-9cba-0f705607edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:00.043404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 411/841] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:15:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:00.315667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178be91c-796b-4d35-b1e3-0c036706b5b6 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:00.392741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:00.443218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178be91c-796b-4d35-b1e3-0c036706b5b6 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:00.479818 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad583a8-1cc6-453d-a525-6ff7d9b187de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:00.480461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad583a8-1cc6-453d-a525-6ff7d9b187de None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:00.480732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad583a8-1cc6-453d-a525-6ff7d9b187de None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:00.480994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad583a8-1cc6-453d-a525-6ff7d9b187de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:00.482137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad583a8-1cc6-453d-a525-6ff7d9b187de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:00.483593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad583a8-1cc6-453d-a525-6ff7d9b187de None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:00.485127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 431/842] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:16:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:00.491422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3bb56-d4d4-4263-9cba-0f705607edef None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:00.574146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:00.600295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3bb56-d4d4-4263-9cba-0f705607edef None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:00.758948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04802b6a-1889-4955-96cf-1a891be5fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:00.759550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04802b6a-1889-4955-96cf-1a891be5fe7c None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:00.759829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04802b6a-1889-4955-96cf-1a891be5fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:00.760096 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04802b6a-1889-4955-96cf-1a891be5fe7c None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:00.760746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04802b6a-1889-4955-96cf-1a891be5fe7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:00.762173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04802b6a-1889-4955-96cf-1a891be5fe7c None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:00.786415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 412/843] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:16:00 2022] POST /identity/v3/users => generated 286 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:16:02.930397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082230-fb71-4e66-ae96-bbb09bdac8a5 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:02.931279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082230-fb71-4e66-ae96-bbb09bdac8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:02.931279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082230-fb71-4e66-ae96-bbb09bdac8a5 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:02.933381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 432/844] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:02.938838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af534fd-155e-43c8-9745-b4a4e7344a4a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:02.939241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af534fd-155e-43c8-9745-b4a4e7344a4a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:02.939357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af534fd-155e-43c8-9745-b4a4e7344a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:02.959358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9af534fd-155e-43c8-9745-b4a4e7344a4a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:02.960693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9af534fd-155e-43c8-9745-b4a4e7344a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:03.027419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 413/845] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:03.293069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082230-fb71-4e66-ae96-bbb09bdac8a5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:03.413287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082230-fb71-4e66-ae96-bbb09bdac8a5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:03.442477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:03.449290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:03.449912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:03.450184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:03.450453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] PATH_INFO: `/v3/roles/60a9b9055fe947f6adfcc4173f804a58` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:03.451872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] RBAC: Authorizing `identity:get_role(role_id=60a9b9055fe947f6adfcc4173f804a58)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:03.453251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:03.454549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 433/846] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:03 2022] GET /identity/v3/roles/60a9b9055fe947f6adfcc4173f804a58 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:03.460734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af534fd-155e-43c8-9745-b4a4e7344a4a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:03.517471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:03.562163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af534fd-155e-43c8-9745-b4a4e7344a4a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:03.598414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:03.599051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:03.599317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:03.599582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] PATH_INFO: `/v3/users/271aa6e23d5b42f3a640b06f79436920` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:03.614853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] RBAC: Authorizing `identity:get_user(user_id=271aa6e23d5b42f3a640b06f79436920)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:03.616358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:03.618029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 414/847] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:03 2022] GET /identity/v3/users/271aa6e23d5b42f3a640b06f79436920 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:03.627428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:03.744429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0af1-f25e-47e0-a25d-00ad7c377565 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:03.780212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf11b1b-26ce-49a6-bbcb-b127ef3a8e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:03.780823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11b1b-26ce-49a6-bbcb-b127ef3a8e3a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:03.781100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11b1b-26ce-49a6-bbcb-b127ef3a8e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:03.781371 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf11b1b-26ce-49a6-bbcb-b127ef3a8e3a None admin] PATH_INFO: `/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:03.782620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf11b1b-26ce-49a6-bbcb-b127ef3a8e3a None admin] RBAC: Authorizing `identity:get_project(project_id=a400b3c6a03b4439b5ea081ba436e2d7)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:03.784103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf11b1b-26ce-49a6-bbcb-b127ef3a8e3a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:03.785728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 434/848] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:16:03 2022] GET /identity/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:03.792382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:03.897556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bb505-389c-4207-bf2f-249e4322877e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:03.915406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:03.933235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297db77-9c8c-41d5-9798-28d354ce362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:03.933888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297db77-9c8c-41d5-9798-28d354ce362e None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:03.934163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297db77-9c8c-41d5-9798-28d354ce362e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:03.934430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297db77-9c8c-41d5-9798-28d354ce362e None admin] PATH_INFO: `/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7/users/271aa6e23d5b42f3a640b06f79436920/roles/60a9b9055fe947f6adfcc4173f804a58` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:03.937057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297db77-9c8c-41d5-9798-28d354ce362e None admin] RBAC: Authorizing `identity:create_grant(project_id=a400b3c6a03b4439b5ea081ba436e2d7, user_id=271aa6e23d5b42f3a640b06f79436920, role_id=60a9b9055fe947f6adfcc4173f804a58)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:03.938468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297db77-9c8c-41d5-9798-28d354ce362e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:03.953500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 415/849] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:16:03 2022] PUT /identity/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7/users/271aa6e23d5b42f3a640b06f79436920/roles/60a9b9055fe947f6adfcc4173f804a58 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:16:06.037895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330182f-52f1-4ee8-99d5-478ebdf6afe5 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:06.038478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330182f-52f1-4ee8-99d5-478ebdf6afe5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:06.038478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330182f-52f1-4ee8-99d5-478ebdf6afe5 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:06.040111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 435/850] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:06.046468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ecb8-aa84-41b4-92ab-528ee01ea99b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:06.047278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ecb8-aa84-41b4-92ab-528ee01ea99b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:06.047417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ecb8-aa84-41b4-92ab-528ee01ea99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:06.069661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8129ecb8-aa84-41b4-92ab-528ee01ea99b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:06.070844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8129ecb8-aa84-41b4-92ab-528ee01ea99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:06.148781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 416/851] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:06.411774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330182f-52f1-4ee8-99d5-478ebdf6afe5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:06.484395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:06.525491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330182f-52f1-4ee8-99d5-478ebdf6afe5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:06.561157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:06.561771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:06.562050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:06.562319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] PATH_INFO: `/v3/roles/60a9b9055fe947f6adfcc4173f804a58` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:06.563817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] RBAC: Authorizing `identity:get_role(role_id=60a9b9055fe947f6adfcc4173f804a58)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:06.565217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:06.566517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 436/852] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:06 2022] GET /identity/v3/roles/60a9b9055fe947f6adfcc4173f804a58 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:06.574046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ecb8-aa84-41b4-92ab-528ee01ea99b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:06.678409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ecb8-aa84-41b4-92ab-528ee01ea99b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:06.688368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:06.718659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:06.719341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:06.719587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:06.719871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] PATH_INFO: `/v3/users/271aa6e23d5b42f3a640b06f79436920` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:06.720985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] RBAC: Authorizing `identity:get_user(user_id=271aa6e23d5b42f3a640b06f79436920)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:06.722406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:06.723994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 417/853] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:06 2022] GET /identity/v3/users/271aa6e23d5b42f3a640b06f79436920 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:06.730015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:06.835526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060083-e746-49d3-83e4-e07fe822f72f None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:06.869776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:06.870361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:06.870634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:06.870940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:06.873792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:06.943911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:06.945374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:07.059197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 437/854] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:16:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:16:07.068025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:07.175940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a300234-5bc0-40ab-8cb4-39a6e06898d9 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:07.213907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dc302-9b15-4527-be97-98f0a1a482e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:07.214459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dc302-9b15-4527-be97-98f0a1a482e1 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:07.214730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dc302-9b15-4527-be97-98f0a1a482e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:07.215024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dc302-9b15-4527-be97-98f0a1a482e1 None admin] PATH_INFO: `/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:07.216265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dc302-9b15-4527-be97-98f0a1a482e1 None admin] RBAC: Authorizing `identity:get_project(project_id=a400b3c6a03b4439b5ea081ba436e2d7)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:07.217677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dc302-9b15-4527-be97-98f0a1a482e1 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:07.219294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 418/855] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:16:07 2022] GET /identity/v3/projects/a400b3c6a03b4439b5ea081ba436e2d7 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:07.228266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:07.262574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:07.333961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae0da-b345-453f-b06a-826e4a71f05b None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:07.369859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c04d31-bf99-40e8-996d-add08bca2a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:07.370454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c04d31-bf99-40e8-996d-add08bca2a74 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:07.370727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c04d31-bf99-40e8-996d-add08bca2a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:07.371027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c04d31-bf99-40e8-996d-add08bca2a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:07.371740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c04d31-bf99-40e8-996d-add08bca2a74 None admin] RBAC: Adding query filter params (role.id=60a9b9055fe947f6adfcc4173f804a58, scope.project.id=a400b3c6a03b4439b5ea081ba436e2d7, user.id=271aa6e23d5b42f3a640b06f79436920) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:16:07.372045 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c04d31-bf99-40e8-996d-add08bca2a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:07.373480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c04d31-bf99-40e8-996d-add08bca2a74 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:07.379274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 438/856] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:16:07 2022] GET /identity/v3/role_assignments?user.id=271aa6e23d5b42f3a640b06f79436920&scope.project.id=a400b3c6a03b4439b5ea081ba436e2d7&role.id=60a9b9055fe947f6adfcc4173f804a58 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:09.489356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25c0a2-6c6e-4bf3-80a0-0745bcef9e80 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:09.490177 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25c0a2-6c6e-4bf3-80a0-0745bcef9e80 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:09.490177 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25c0a2-6c6e-4bf3-80a0-0745bcef9e80 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:09.492367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 419/857] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:09.498657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfb1c4-08a9-4463-a029-b4892169470d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:09.499463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfb1c4-08a9-4463-a029-b4892169470d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:09.499604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfb1c4-08a9-4463-a029-b4892169470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:09.522675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-92cfb1c4-08a9-4463-a029-b4892169470d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:09.523886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-92cfb1c4-08a9-4463-a029-b4892169470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:09.595298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 439/858] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:09.867563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25c0a2-6c6e-4bf3-80a0-0745bcef9e80 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:09.914301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:09.970696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25c0a2-6c6e-4bf3-80a0-0745bcef9e80 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:10.005737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fa8a2-ed75-4e9e-a55a-2c4a307bc52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:10.006355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa8a2-ed75-4e9e-a55a-2c4a307bc52a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:10.006683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa8a2-ed75-4e9e-a55a-2c4a307bc52a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:10.006999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa8a2-ed75-4e9e-a55a-2c4a307bc52a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:10.008229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fa8a2-ed75-4e9e-a55a-2c4a307bc52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:10.009669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fa8a2-ed75-4e9e-a55a-2c4a307bc52a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:10.011281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 420/859] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:10.020238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfb1c4-08a9-4463-a029-b4892169470d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:10.049189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:10.123894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfb1c4-08a9-4463-a029-b4892169470d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:10.158766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745671-96b6-4c64-9995-9399fe4bce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:10.159390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745671-96b6-4c64-9995-9399fe4bce0b None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:10.159659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745671-96b6-4c64-9995-9399fe4bce0b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:10.159923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745671-96b6-4c64-9995-9399fe4bce0b None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:10.160563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745671-96b6-4c64-9995-9399fe4bce0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:10.161977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745671-96b6-4c64-9995-9399fe4bce0b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:10.193560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 440/860] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:16:10 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:16:12.324039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a94e5-fd69-40ee-9c8e-bf1ba1153a69 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:12.324836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a94e5-fd69-40ee-9c8e-bf1ba1153a69 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:12.324836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a94e5-fd69-40ee-9c8e-bf1ba1153a69 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:12.326982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 421/861] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:12.336125 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380df4-ddcd-4cf0-a3be-8c7384e3b56d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:12.336547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380df4-ddcd-4cf0-a3be-8c7384e3b56d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:12.336738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380df4-ddcd-4cf0-a3be-8c7384e3b56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:12.360909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f2380df4-ddcd-4cf0-a3be-8c7384e3b56d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:12.362111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f2380df4-ddcd-4cf0-a3be-8c7384e3b56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:12.433475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 441/862] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:12.704305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a94e5-fd69-40ee-9c8e-bf1ba1153a69 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:12.813953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a94e5-fd69-40ee-9c8e-bf1ba1153a69 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:12.834107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:12.857932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbccc2-7d87-4100-b265-0ceb822abd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:12.858546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbccc2-7d87-4100-b265-0ceb822abd83 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:12.858840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbccc2-7d87-4100-b265-0ceb822abd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:12.859121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbccc2-7d87-4100-b265-0ceb822abd83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:12.860401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbccc2-7d87-4100-b265-0ceb822abd83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:12.861835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbccc2-7d87-4100-b265-0ceb822abd83 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:12.863435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 422/863] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:16:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:12.869979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2380df4-ddcd-4cf0-a3be-8c7384e3b56d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:12.882064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:12.981162 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2380df4-ddcd-4cf0-a3be-8c7384e3b56d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:13.017888 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024887e8-2ece-4bb6-ae2a-a69e10db147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:13.018480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024887e8-2ece-4bb6-ae2a-a69e10db147a None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:13.018749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024887e8-2ece-4bb6-ae2a-a69e10db147a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:13.019047 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024887e8-2ece-4bb6-ae2a-a69e10db147a None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:13.019762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024887e8-2ece-4bb6-ae2a-a69e10db147a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:13.021199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024887e8-2ece-4bb6-ae2a-a69e10db147a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:13.044657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 442/864] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:16:12 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:16:15.179682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e127-408b-4a31-b09a-3cfafbd4de2e None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:15.180558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e127-408b-4a31-b09a-3cfafbd4de2e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:15.180558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e127-408b-4a31-b09a-3cfafbd4de2e None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:15.182669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 423/865] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:15.188932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bacd1-2433-4eef-87d0-274e67b59bb4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:15.189600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bacd1-2433-4eef-87d0-274e67b59bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:15.189825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bacd1-2433-4eef-87d0-274e67b59bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:15.216710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-344bacd1-2433-4eef-87d0-274e67b59bb4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:15.217902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-344bacd1-2433-4eef-87d0-274e67b59bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:15.284471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:15.293731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 443/866] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:15.557207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e127-408b-4a31-b09a-3cfafbd4de2e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:15.673303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e127-408b-4a31-b09a-3cfafbd4de2e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:15.709908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:15.710608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:15.710886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:15.711154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:15.721641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:16:15.726582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:16:15.727656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:16:15.728489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 424/867] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:16:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:16:15.734444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bacd1-2433-4eef-87d0-274e67b59bb4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:15.847106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bacd1-2433-4eef-87d0-274e67b59bb4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:15.883137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:15.883725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:15.883996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:15.884255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:15.884909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:16:15.885201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:15.886563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:15.894671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 444/868] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:16:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:15.902248 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:15.954322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:16.017351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413032c6-d0a8-4c8b-8c4a-9a5847983029 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:16.054898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:16.055905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:16.056332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:16.056750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] PATH_INFO: `/v3/users/9a4fad85bb2e4b929bbefb60e7b1b255` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:16.075548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] RBAC: Authorizing `identity:get_user(user_id=9a4fad85bb2e4b929bbefb60e7b1b255)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:16.076974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:16.078566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 425/869] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:15 2022] GET /identity/v3/users/9a4fad85bb2e4b929bbefb60e7b1b255 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:16.085130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:16.152535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:16.196559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c889b-1321-4756-85c4-39c9bc7f1b55 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:16.230520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29885451-64b2-410d-a770-481f1794bd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:16.231180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885451-64b2-410d-a770-481f1794bd9b None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:16.231435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885451-64b2-410d-a770-481f1794bd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:16.231706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885451-64b2-410d-a770-481f1794bd9b None admin] PATH_INFO: `/v3/projects/9068ba536ab24fe9adbaeecb8cd7cc6f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:16.232900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29885451-64b2-410d-a770-481f1794bd9b None admin] RBAC: Authorizing `identity:get_project(project_id=9068ba536ab24fe9adbaeecb8cd7cc6f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:16.234345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29885451-64b2-410d-a770-481f1794bd9b None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:16.235979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 445/870] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:16:16 2022] GET /identity/v3/projects/9068ba536ab24fe9adbaeecb8cd7cc6f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:16.242790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:16.344941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:16.349074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edfaab-b31a-47f5-b01a-3abc75ab2b0a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:16.384654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d4519-f9d1-42b5-99ad-379b422c2c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:16.385294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4519-f9d1-42b5-99ad-379b422c2c85 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:16.385564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4519-f9d1-42b5-99ad-379b422c2c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:16.385832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4519-f9d1-42b5-99ad-379b422c2c85 None admin] PATH_INFO: `/v3/projects/9068ba536ab24fe9adbaeecb8cd7cc6f/users/9a4fad85bb2e4b929bbefb60e7b1b255/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:16.387855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d4519-f9d1-42b5-99ad-379b422c2c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=9068ba536ab24fe9adbaeecb8cd7cc6f, user_id=9a4fad85bb2e4b929bbefb60e7b1b255, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:16.389281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d4519-f9d1-42b5-99ad-379b422c2c85 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:16.411136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 426/871] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:16:16 2022] PUT /identity/v3/projects/9068ba536ab24fe9adbaeecb8cd7cc6f/users/9a4fad85bb2e4b929bbefb60e7b1b255/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:16:18.504299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb6569-d1a1-43cc-aba1-71fd354a93a0 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:18.504844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb6569-d1a1-43cc-aba1-71fd354a93a0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:18.504844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb6569-d1a1-43cc-aba1-71fd354a93a0 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:18.506186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 446/872] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:18.512668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586b56-e396-4b5a-9873-9947d715069a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:18.513434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586b56-e396-4b5a-9873-9947d715069a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:18.513558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586b56-e396-4b5a-9873-9947d715069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:18.542242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b4586b56-e396-4b5a-9873-9947d715069a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:18.543473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b4586b56-e396-4b5a-9873-9947d715069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:18.612236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 427/873] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:18.891286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb6569-d1a1-43cc-aba1-71fd354a93a0 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:19.003242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb6569-d1a1-43cc-aba1-71fd354a93a0 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:19.029638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:19.038987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:19.039927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:19.040205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:19.040455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:19.051272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:16:19.056254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:16:19.057305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:19.058276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:16:19.062600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 447/874] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:16:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:16:19.063698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586b56-e396-4b5a-9873-9947d715069a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:19.156769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:19.171193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586b56-e396-4b5a-9873-9947d715069a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:19.204911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:19.205505 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:19.205774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:19.206039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:19.206693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:16:19.207016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:19.208367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:19.216400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 428/875] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:16:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:16:19.223211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:19.322851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b51b-4bc3-4a85-acea-d45a479ee9d9 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:19.358558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:19.359212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:19.359489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:19.359755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] PATH_INFO: `/v3/users/9a4fad85bb2e4b929bbefb60e7b1b255` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:19.361014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] RBAC: Authorizing `identity:get_user(user_id=9a4fad85bb2e4b929bbefb60e7b1b255)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:19.362457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:19.364062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 448/876] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:19 2022] GET /identity/v3/users/9a4fad85bb2e4b929bbefb60e7b1b255 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:19.370239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:19.475755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e215bf-4fbf-4d06-9e2d-cb2e358fd2f5 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:19.509333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:19.509932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:19.510202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:19.510468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:19.530562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:19.580442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:19.581855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:19.695517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 429/877] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:16:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:16:19.701778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:19.772094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:19.817092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a10d1-60d1-47c6-a89a-e8096523bf6c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:19.863152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3c026-fc82-4265-b849-4cca3b80591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:19.863776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c026-fc82-4265-b849-4cca3b80591c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:19.864052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c026-fc82-4265-b849-4cca3b80591c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:19.864318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c026-fc82-4265-b849-4cca3b80591c None admin] PATH_INFO: `/v3/projects/9068ba536ab24fe9adbaeecb8cd7cc6f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:19.865492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3c026-fc82-4265-b849-4cca3b80591c None admin] RBAC: Authorizing `identity:get_project(project_id=9068ba536ab24fe9adbaeecb8cd7cc6f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:19.867105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3c026-fc82-4265-b849-4cca3b80591c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:19.868711 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 449/878] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:16:19 2022] GET /identity/v3/projects/9068ba536ab24fe9adbaeecb8cd7cc6f => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:19.875677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:19.931668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:19.981792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68570a05-eb76-4116-abf3-ea9513bed96e None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:20.017376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de40e4-14e4-4bb8-a1e3-f41a03c6d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:20.017964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de40e4-14e4-4bb8-a1e3-f41a03c6d098 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:20.018238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de40e4-14e4-4bb8-a1e3-f41a03c6d098 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:20.018502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de40e4-14e4-4bb8-a1e3-f41a03c6d098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:20.019256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de40e4-14e4-4bb8-a1e3-f41a03c6d098 None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=9068ba536ab24fe9adbaeecb8cd7cc6f, user.id=9a4fad85bb2e4b929bbefb60e7b1b255) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:16:20.019557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de40e4-14e4-4bb8-a1e3-f41a03c6d098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:20.020968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de40e4-14e4-4bb8-a1e3-f41a03c6d098 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:20.026983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 430/879] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:16:19 2022] GET /identity/v3/role_assignments?user.id=9a4fad85bb2e4b929bbefb60e7b1b255&scope.project.id=9068ba536ab24fe9adbaeecb8cd7cc6f&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:22.138348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c0a2-e9cf-403a-8132-cedf6ffce698 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:22.138952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c0a2-e9cf-403a-8132-cedf6ffce698 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:22.138952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c0a2-e9cf-403a-8132-cedf6ffce698 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:22.141012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 450/880] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:22.149351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638446-11e3-41e8-b1f4-d46f616c9886 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:22.149780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638446-11e3-41e8-b1f4-d46f616c9886 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:22.149888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638446-11e3-41e8-b1f4-d46f616c9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:22.169647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-69638446-11e3-41e8-b1f4-d46f616c9886 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:22.170849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-69638446-11e3-41e8-b1f4-d46f616c9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:22.249957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 431/881] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:16:22.519459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0c0a2-e9cf-403a-8132-cedf6ffce698 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:22.632875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0c0a2-e9cf-403a-8132-cedf6ffce698 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:22.656055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:22.676861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67496068-74d8-4b3e-91b5-5d6ad5857b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:22.677723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496068-74d8-4b3e-91b5-5d6ad5857b11 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:22.678097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496068-74d8-4b3e-91b5-5d6ad5857b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:22.678505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496068-74d8-4b3e-91b5-5d6ad5857b11 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:22.679200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67496068-74d8-4b3e-91b5-5d6ad5857b11 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:22.680589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67496068-74d8-4b3e-91b5-5d6ad5857b11 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:22.698630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 451/882] 10.222.0.16 () {60 vars in 1138 bytes} [Tue Oct 11 13:16:22 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:16:24.853408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37462c1-3229-41c5-a382-ef3bb682f919 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:24.854336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37462c1-3229-41c5-a382-ef3bb682f919 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:24.854336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37462c1-3229-41c5-a382-ef3bb682f919 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:24.856522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 432/883] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:24.865367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4b248-442b-4038-9a37-881c0cd15c04 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:24.865853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4b248-442b-4038-9a37-881c0cd15c04 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:24.866146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4b248-442b-4038-9a37-881c0cd15c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:24.886413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6ff4b248-442b-4038-9a37-881c0cd15c04 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:24.887637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6ff4b248-442b-4038-9a37-881c0cd15c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:24.962052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 452/884] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:25.228295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37462c1-3229-41c5-a382-ef3bb682f919 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:25.280136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:25.338119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37462c1-3229-41c5-a382-ef3bb682f919 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:25.376005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31170e0-9389-4057-944e-c716b92cb9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:25.376621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31170e0-9389-4057-944e-c716b92cb9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:25.376895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31170e0-9389-4057-944e-c716b92cb9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:25.377165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31170e0-9389-4057-944e-c716b92cb9a3 None admin] PATH_INFO: `/v3/domains/fc2158724df2424390dd16ef9fa59017` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:25.388060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31170e0-9389-4057-944e-c716b92cb9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fc2158724df2424390dd16ef9fa59017)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:25.389498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31170e0-9389-4057-944e-c716b92cb9a3 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:25.391116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 433/885] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Oct 11 13:16:25 2022] GET /identity/v3/domains/fc2158724df2424390dd16ef9fa59017 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:25.397594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4b248-442b-4038-9a37-881c0cd15c04 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:25.495103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4b248-442b-4038-9a37-881c0cd15c04 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:25.508145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:25.530156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08814a-db4e-4638-9176-5dbf202f63eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:25.530772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08814a-db4e-4638-9176-5dbf202f63eb None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:25.531086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08814a-db4e-4638-9176-5dbf202f63eb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:25.531354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08814a-db4e-4638-9176-5dbf202f63eb None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:25.532000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08814a-db4e-4638-9176-5dbf202f63eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:25.533447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08814a-db4e-4638-9176-5dbf202f63eb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:25.565542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 453/886] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:16:25 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:16:27.716082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a922cb2-2a86-42a8-912d-c6280f548e20 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:27.716931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a922cb2-2a86-42a8-912d-c6280f548e20 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:27.716931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a922cb2-2a86-42a8-912d-c6280f548e20 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:27.719222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 434/887] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:27.724623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fb34c-41ae-47d3-96da-4d326687c68a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:27.725046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fb34c-41ae-47d3-96da-4d326687c68a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:27.725221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fb34c-41ae-47d3-96da-4d326687c68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:27.745129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6a1fb34c-41ae-47d3-96da-4d326687c68a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:27.746299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6a1fb34c-41ae-47d3-96da-4d326687c68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:27.817476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 454/888] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:28.083625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a922cb2-2a86-42a8-912d-c6280f548e20 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:28.196691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a922cb2-2a86-42a8-912d-c6280f548e20 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:28.199011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:28.241551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb531e-2df1-46f7-8a06-4b052191d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:28.242188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb531e-2df1-46f7-8a06-4b052191d8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:28.242487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb531e-2df1-46f7-8a06-4b052191d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:28.242752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb531e-2df1-46f7-8a06-4b052191d8f1 None admin] PATH_INFO: `/v3/domains/fc2158724df2424390dd16ef9fa59017` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:28.243954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb531e-2df1-46f7-8a06-4b052191d8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fc2158724df2424390dd16ef9fa59017)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:28.245377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb531e-2df1-46f7-8a06-4b052191d8f1 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:28.246957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 435/889] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Oct 11 13:16:28 2022] GET /identity/v3/domains/fc2158724df2424390dd16ef9fa59017 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:28.252904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fb34c-41ae-47d3-96da-4d326687c68a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:28.351575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:28.360095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fb34c-41ae-47d3-96da-4d326687c68a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:28.396124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e964214-0784-4fe3-8d29-b162d101a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:28.396727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e964214-0784-4fe3-8d29-b162d101a0cd None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:28.396999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e964214-0784-4fe3-8d29-b162d101a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:28.397299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e964214-0784-4fe3-8d29-b162d101a0cd None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:28.397963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e964214-0784-4fe3-8d29-b162d101a0cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:28.399421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e964214-0784-4fe3-8d29-b162d101a0cd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:28.423776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 455/890] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:16:28 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:16:30.543299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac345b-533d-4af3-a0cc-dec2c0adabf5 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:30.544158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac345b-533d-4af3-a0cc-dec2c0adabf5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:30.544158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac345b-533d-4af3-a0cc-dec2c0adabf5 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:30.546446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 436/891] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:30.551980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfebe21-b7f9-4faa-a4d2-1989a3aeed06 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:30.552406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfebe21-b7f9-4faa-a4d2-1989a3aeed06 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:30.552506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfebe21-b7f9-4faa-a4d2-1989a3aeed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:30.572328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-abfebe21-b7f9-4faa-a4d2-1989a3aeed06 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:30.573493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-abfebe21-b7f9-4faa-a4d2-1989a3aeed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:30.641383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 456/892] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:30.904197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac345b-533d-4af3-a0cc-dec2c0adabf5 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:31.022658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac345b-533d-4af3-a0cc-dec2c0adabf5 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:31.063397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:31.064484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:31.064851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:31.065215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:31.078143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:16:31.082850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:16:31.083935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:31.085041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:16:31.086995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 437/893] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:16:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:16:31.090240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfebe21-b7f9-4faa-a4d2-1989a3aeed06 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:31.181673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:31.202097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfebe21-b7f9-4faa-a4d2-1989a3aeed06 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:31.236830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:31.237425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:31.237698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:31.237968 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:31.238617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:16:31.238946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:31.240318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:31.248216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 457/894] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:16:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:31.254877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:31.288644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:31.362086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124d212-fee5-4a11-b92c-e70624714cd8 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:31.396415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:31.397038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:31.397333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:31.397600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] PATH_INFO: `/v3/users/2ea0c2f029864d86b44753fda9d0e83d` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:31.411964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] RBAC: Authorizing `identity:get_user(user_id=2ea0c2f029864d86b44753fda9d0e83d)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:31.413379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:31.415302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 438/895] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:31 2022] GET /identity/v3/users/2ea0c2f029864d86b44753fda9d0e83d => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:31.424613 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:31.542854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59e8b-698f-41eb-a70d-3d9bd9f3b7ec None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:31.577667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be718f8-1f8f-4996-97d1-e8ab5ed5fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:31.578245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be718f8-1f8f-4996-97d1-e8ab5ed5fb6e None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:31.578538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be718f8-1f8f-4996-97d1-e8ab5ed5fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:31.578807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be718f8-1f8f-4996-97d1-e8ab5ed5fb6e None admin] PATH_INFO: `/v3/projects/d4df533473654ac6b4c41cf946fd4a8b` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:31.580080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be718f8-1f8f-4996-97d1-e8ab5ed5fb6e None admin] RBAC: Authorizing `identity:get_project(project_id=d4df533473654ac6b4c41cf946fd4a8b)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:31.581514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be718f8-1f8f-4996-97d1-e8ab5ed5fb6e None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:31.583173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 458/896] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:16:31 2022] GET /identity/v3/projects/d4df533473654ac6b4c41cf946fd4a8b => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:31.590144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:31.696423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:31.713104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19669d5-ad22-4967-b082-b7dff5db912b None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:31.748382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41208a9-a207-4617-bdd7-143254874b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:31.749022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41208a9-a207-4617-bdd7-143254874b56 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:31.749295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41208a9-a207-4617-bdd7-143254874b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:31.749562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41208a9-a207-4617-bdd7-143254874b56 None admin] PATH_INFO: `/v3/projects/d4df533473654ac6b4c41cf946fd4a8b/users/2ea0c2f029864d86b44753fda9d0e83d/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:31.751573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41208a9-a207-4617-bdd7-143254874b56 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4df533473654ac6b4c41cf946fd4a8b, user_id=2ea0c2f029864d86b44753fda9d0e83d, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:31.752988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41208a9-a207-4617-bdd7-143254874b56 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:31.767760 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 439/897] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:16:31 2022] PUT /identity/v3/projects/d4df533473654ac6b4c41cf946fd4a8b/users/2ea0c2f029864d86b44753fda9d0e83d/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:16:33.851896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a57d5-4335-44b3-87ca-800e24d9e948 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:33.852506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a57d5-4335-44b3-87ca-800e24d9e948 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:33.852506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a57d5-4335-44b3-87ca-800e24d9e948 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:33.853794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 459/898] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:16:33.860179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2f79-2a07-412f-b8bc-eef9d00a5d0f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:33.860920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2f79-2a07-412f-b8bc-eef9d00a5d0f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:33.861048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2f79-2a07-412f-b8bc-eef9d00a5d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:33.883399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fe1a2f79-2a07-412f-b8bc-eef9d00a5d0f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:16:33.884575 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fe1a2f79-2a07-412f-b8bc-eef9d00a5d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:16:33.955712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 440/899] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:16:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:16:34.223609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a57d5-4335-44b3-87ca-800e24d9e948 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:34.239056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:34.340711 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a57d5-4335-44b3-87ca-800e24d9e948 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:34.376333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:34.376982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:34.377261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:34.377531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:34.389179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:16:34.394020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:16:34.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:16:34.399958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 460/900] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:16:34.401463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2f79-2a07-412f-b8bc-eef9d00a5d0f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:34.484210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:34.506942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2f79-2a07-412f-b8bc-eef9d00a5d0f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:34.543531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:34.544130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:34.544400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:34.544661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:34.545313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:16:34.545609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:34.547001 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:34.555264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 441/901] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:16:34.561390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:34.641255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:34.673379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c759a-1b9b-45ec-8599-932dde6ecd44 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:34.708716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:34.709332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:34.709723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:34.709911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] PATH_INFO: `/v3/users/2ea0c2f029864d86b44753fda9d0e83d` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:34.711204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea0c2f029864d86b44753fda9d0e83d)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:34.712653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:34.714210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 461/902] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Oct 11 13:16:34 2022] GET /identity/v3/users/2ea0c2f029864d86b44753fda9d0e83d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:34.723572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:34.828249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a0ee0-db36-4b92-88d8-4744b53abf69 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:34.865519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:34.866200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:34.866482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:34.866747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:34.878571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:34.938726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:34.940199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:35.039672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 442/903] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:16:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:16:35.046043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:35.147394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8514e5b-b8e2-4237-8a71-8d88421693d8 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:35.183186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb694a1a-dae8-48d5-ab31-43e7bc819750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:35.183791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694a1a-dae8-48d5-ab31-43e7bc819750 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:35.184061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694a1a-dae8-48d5-ab31-43e7bc819750 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:35.184328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694a1a-dae8-48d5-ab31-43e7bc819750 None admin] PATH_INFO: `/v3/projects/d4df533473654ac6b4c41cf946fd4a8b` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:35.185486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb694a1a-dae8-48d5-ab31-43e7bc819750 None admin] RBAC: Authorizing `identity:get_project(project_id=d4df533473654ac6b4c41cf946fd4a8b)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:35.186941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb694a1a-dae8-48d5-ab31-43e7bc819750 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:35.188533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 462/904] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Oct 11 13:16:35 2022] GET /identity/v3/projects/d4df533473654ac6b4c41cf946fd4a8b => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:35.194991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:16:35.237969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:35.300201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f876-e213-4789-ad6b-0a6968c12c1a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:16:35.340495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec55823-09fa-4475-8c77-24e73ffabf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:16:35.341110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec55823-09fa-4475-8c77-24e73ffabf0a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:16:35.341381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec55823-09fa-4475-8c77-24e73ffabf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:16:35.341646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec55823-09fa-4475-8c77-24e73ffabf0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:16:35.342363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec55823-09fa-4475-8c77-24e73ffabf0a None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=d4df533473654ac6b4c41cf946fd4a8b, user.id=2ea0c2f029864d86b44753fda9d0e83d) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:16:35.342661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec55823-09fa-4475-8c77-24e73ffabf0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:16:35.344119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec55823-09fa-4475-8c77-24e73ffabf0a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:16:35.350488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 443/905] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:16:35 2022] GET /identity/v3/role_assignments?user.id=2ea0c2f029864d86b44753fda9d0e83d&scope.project.id=d4df533473654ac6b4c41cf946fd4a8b&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:16:45.178325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:16:45.347583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=47 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:30.244805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84557-548e-4d66-9e2f-5e3d8712e27d None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:30.245417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84557-548e-4d66-9e2f-5e3d8712e27d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:30.245417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84557-548e-4d66-9e2f-5e3d8712e27d None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:30.247494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 463/906] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:30.253019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2cc4e-ab68-4ab9-a661-9209a4285a38 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:30.253511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2cc4e-ab68-4ab9-a661-9209a4285a38 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:30.253594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2cc4e-ab68-4ab9-a661-9209a4285a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:30.274612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3ec2cc4e-ab68-4ab9-a661-9209a4285a38 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:30.276084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3ec2cc4e-ab68-4ab9-a661-9209a4285a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:30.362879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 444/907] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:17:30.687533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84557-548e-4d66-9e2f-5e3d8712e27d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:30.807960 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84557-548e-4d66-9e2f-5e3d8712e27d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:30.845645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:30.846284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:30.846618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:30.846847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:30.858117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:30.859633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:30.876193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:30.877266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:30.878233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:30.878233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:30.878233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:30.878233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 464/908] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:30.885928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2cc4e-ab68-4ab9-a661-9209a4285a38 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:31.007719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2cc4e-ab68-4ab9-a661-9209a4285a38 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:31.042299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:31.050136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca4e1-5292-48b2-8409-eb6eb0e5a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:31.050805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca4e1-5292-48b2-8409-eb6eb0e5a544 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:31.051179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca4e1-5292-48b2-8409-eb6eb0e5a544 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:31.051474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca4e1-5292-48b2-8409-eb6eb0e5a544 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:31.052122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dca4e1-5292-48b2-8409-eb6eb0e5a544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:31.052514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dca4e1-5292-48b2-8409-eb6eb0e5a544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:31.054226 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dca4e1-5292-48b2-8409-eb6eb0e5a544 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:31.070448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 445/909] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:31.072197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:31.136240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:31.192616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231621b-a2a8-4462-b4ab-df7513bce0d1 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:31.231932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab75fa0-827b-4aa1-aaf4-330fd85a10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:31.232553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75fa0-827b-4aa1-aaf4-330fd85a10ab None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:31.232830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75fa0-827b-4aa1-aaf4-330fd85a10ab None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:31.233269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75fa0-827b-4aa1-aaf4-330fd85a10ab None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:31.233939 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab75fa0-827b-4aa1-aaf4-330fd85a10ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:31.235427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab75fa0-827b-4aa1-aaf4-330fd85a10ab None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:31.262179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 465/910] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Oct 11 13:17:31 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:17:33.449925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96abb0-91d1-4cc2-a132-6487ca94c228 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:33.450485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96abb0-91d1-4cc2-a132-6487ca94c228 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:33.450620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96abb0-91d1-4cc2-a132-6487ca94c228 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:33.451980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 446/911] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:33.458046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f62dd-1be0-4c49-9321-294f1e8ec73b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:33.458539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f62dd-1be0-4c49-9321-294f1e8ec73b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:33.458539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f62dd-1be0-4c49-9321-294f1e8ec73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:33.477639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1a3f62dd-1be0-4c49-9321-294f1e8ec73b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:33.478931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a3f62dd-1be0-4c49-9321-294f1e8ec73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:33.554960 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 466/912] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:17:33.819668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96abb0-91d1-4cc2-a132-6487ca94c228 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:33.959424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96abb0-91d1-4cc2-a132-6487ca94c228 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:34.003201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:34.004041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:34.004435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:34.004786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:34.020729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:17:34.026951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:34.027914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:34.028761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 447/913] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:17:34.035289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f62dd-1be0-4c49-9321-294f1e8ec73b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:34.083589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:34.158051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f62dd-1be0-4c49-9321-294f1e8ec73b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:34.205956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:34.206601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:34.206901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:34.207166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:34.207843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] RBAC: Adding query filter params (name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:34.208121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:34.209533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:34.218343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 467/914] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:17:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:34.224349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:34.276675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:34.338907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce97e8-5a56-423c-bd72-c848a36bef85 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:34.383675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:34.384326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:34.384602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:34.384874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:34.398521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:34.400283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:34.417171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:34.418194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:34.419099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:34.419099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:34.419099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:34.419099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 448/915] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:34.425969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:34.537892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:34.541557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3885216-1af0-4af4-80fc-452ab097b171 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:34.581407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:34.582690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:34.582690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:34.582690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:34.583409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:34.583712 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:34.585240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:34.599390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 468/916] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:34.605536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:34.714755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f032a-c9d8-4f97-b283-9bb6d131691a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:34.716764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:34.754411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:34.755729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:34.755729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:34.756009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:34.763740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:34.765175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:17:34.777449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:34.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:34.779779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 449/917] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:34.784657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:34.898860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51659-dc8a-44c5-aa41-807621c143cd None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:34.935658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:34.936269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:34.936538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:34.936806 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:34.937530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:34.937825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:34.940059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:34.959129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 469/918] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Oct 11 13:17:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:34.965118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:35.089178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818f94c-24ad-4049-8b27-c948bf656d2d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:35.131802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:35.132442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:35.132713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:35.132979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:35.143859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:35.145284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:35.159432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:35.160524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:35.161406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:35.161406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:35.161406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:35.161406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 450/919] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:17:35.166665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:35.187385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:35.281991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7181-3cbf-41ad-a49b-349b514b14a9 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:35.328288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:35.329229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:35.329425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:35.329677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:35.330588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:35.331038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:35.334183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:35.345594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 470/920] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:35.351852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:35.373964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:35.467176 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed75d4-33f6-4d99-9b2f-3f4c79471baf None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:35.503511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:35.504139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:35.504419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:35.504690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:35.512237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:35.513656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:17:35.525499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:35.526432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:35.527410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 451/921] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:17:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:35.535487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:35.622041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:35.648388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926d49-7e6f-45c7-8f04-301ff3dfd54a None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:35.688350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c20291-d955-4a9d-8b39-25a5d4aac0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:35.688968 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20291-d955-4a9d-8b39-25a5d4aac0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:35.689245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20291-d955-4a9d-8b39-25a5d4aac0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:35.689514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20291-d955-4a9d-8b39-25a5d4aac0e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:35.690207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c20291-d955-4a9d-8b39-25a5d4aac0e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:35.690512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c20291-d955-4a9d-8b39-25a5d4aac0e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:35.691978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c20291-d955-4a9d-8b39-25a5d4aac0e0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:35.706317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 471/922] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:17:35.712321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:35.793249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:35.821077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad55a2-e8a4-4149-ab2c-c5c423bd366d None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:35.862727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7a873-4b22-4fd2-9178-1e8a3d9990b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:35.863467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a873-4b22-4fd2-9178-1e8a3d9990b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:35.863746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a873-4b22-4fd2-9178-1e8a3d9990b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:35.864021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a873-4b22-4fd2-9178-1e8a3d9990b2 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/a0085283bb7642b1a37fbd122831289d/roles/d58da09371854b4ab217716b0492fb82` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:35.882374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7a873-4b22-4fd2-9178-1e8a3d9990b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=a0085283bb7642b1a37fbd122831289d, role_id=d58da09371854b4ab217716b0492fb82)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:35.883921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7a873-4b22-4fd2-9178-1e8a3d9990b2 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:35.898739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 452/923] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:17:35 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/a0085283bb7642b1a37fbd122831289d/roles/d58da09371854b4ab217716b0492fb82 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:17:38.110071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a2422-a088-4f8a-a101-c09ebe4daa92 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:38.110628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a2422-a088-4f8a-a101-c09ebe4daa92 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:38.110628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a2422-a088-4f8a-a101-c09ebe4daa92 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:38.111994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 472/924] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:38.118216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72137-d31c-4268-b6b3-94f66c325259 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:38.118693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72137-d31c-4268-b6b3-94f66c325259 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:38.118793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72137-d31c-4268-b6b3-94f66c325259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:38.146876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-92c72137-d31c-4268-b6b3-94f66c325259 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:38.148803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-92c72137-d31c-4268-b6b3-94f66c325259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:38.219337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 453/925] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:17:38.483800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a2422-a088-4f8a-a101-c09ebe4daa92 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:38.583740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a2422-a088-4f8a-a101-c09ebe4daa92 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:38.617124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:38.617753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:38.618028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:38.618290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:38.625047 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:38.629148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:17:38.634421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:38.635372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:38.636444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 473/926] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Oct 11 13:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:38.641820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c72137-d31c-4268-b6b3-94f66c325259 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:38.703875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:38.754249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c72137-d31c-4268-b6b3-94f66c325259 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:38.790199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:38.791140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:38.791420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:38.791718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:38.792348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:38.792645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:38.794022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:38.802105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 454/927] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Oct 11 13:17:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:38.808053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:38.915116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eb77f-3589-4907-8652-bb247a455978 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:38.952160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:38.952795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:38.953071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:38.953336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:38.966426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:38.967915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:38.982922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:38.983928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:38.985447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:38.985447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:38.985447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:38.985447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 474/928] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:38.990394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:39.104564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7885b74-10a1-4b3c-a44b-39e1503dcb60 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:39.121679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:39.141722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:39.142432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:39.142808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:39.143227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:39.143970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:39.144332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:39.145692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:39.159229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 455/929] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:39.165979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:39.222147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:39.277745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9fa0a-38b7-45f7-a5bc-1901c5430221 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:39.317905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:39.318752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:39.319241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:39.319673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:39.332609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:39.334086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:17:39.346751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:39.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:39.349345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 475/930] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:39.355203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:39.483076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac1437-91c5-4502-8bdc-7b44675926b8 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:39.522784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:39.523445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:39.523720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:39.523985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:39.524706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:39.525005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:39.526474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:39.544228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 456/931] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Oct 11 13:17:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:39.550064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:39.652028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fbd1b-b03d-4419-81eb-735554ff59c9 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:39.663187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:39.691106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:39.691823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:39.692119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:39.692508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:39.769054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:39.770528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:39.879436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 476/932] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:17:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:17:39.885572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:39.921284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:39.994366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1219-dbc5-4032-b536-eb2577d764be None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:40.038981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:40.039706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:40.039986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:40.040255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:40.051046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:40.052499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:40.068000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:40.069508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:40.070564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:40.070564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:40.070564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:40.074030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 457/933] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:40.075206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:40.088028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:40.179430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b5dd0-31b2-44f0-9460-b7c6b23d91ed None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:40.219509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:40.220122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:40.220419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:40.220676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:40.221339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:40.221637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:40.223068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:40.235386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 477/934] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:17:40.241267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:40.342444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:40.361494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6261-9510-44aa-a17b-c7fe14ce8af2 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:40.399899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:40.400529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:40.400799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:40.401064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:40.407730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:40.409245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:17:40.421113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:40.422062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:40.423122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 458/935] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:40.429213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:40.506965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:40.540893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498821f-9b9d-4f3e-8535-a5e843f94a01 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:40.577149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a0f76-d46c-442d-b387-6a426bfe9532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:40.577741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0f76-d46c-442d-b387-6a426bfe9532 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:40.578025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0f76-d46c-442d-b387-6a426bfe9532 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:40.578311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0f76-d46c-442d-b387-6a426bfe9532 None admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:40.579016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a0f76-d46c-442d-b387-6a426bfe9532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:40.579321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a0f76-d46c-442d-b387-6a426bfe9532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:40.580761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a0f76-d46c-442d-b387-6a426bfe9532 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:40.593832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 478/936] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:40.600910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:40.704402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74370e0a-6149-48ae-9bac-f7b08a6c6b7f None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:40.741433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5997-49bf-4597-a3c8-8b5140e8a401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:40.742043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5997-49bf-4597-a3c8-8b5140e8a401 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:40.742323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5997-49bf-4597-a3c8-8b5140e8a401 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:40.742597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5997-49bf-4597-a3c8-8b5140e8a401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:40.743377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5997-49bf-4597-a3c8-8b5140e8a401 None admin] RBAC: Adding query filter params (role.id=d58da09371854b4ab217716b0492fb82, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=a0085283bb7642b1a37fbd122831289d) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:40.743686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5997-49bf-4597-a3c8-8b5140e8a401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:40.745114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5997-49bf-4597-a3c8-8b5140e8a401 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:40.751100 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 459/937] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:17:40 2022] GET /identity/v3/role_assignments?user.id=a0085283bb7642b1a37fbd122831289d&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=d58da09371854b4ab217716b0492fb82 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:42.995138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07346-cd1f-4773-a52d-e5b6b6969975 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:42.995741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07346-cd1f-4773-a52d-e5b6b6969975 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:42.995741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07346-cd1f-4773-a52d-e5b6b6969975 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:42.997214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 479/938] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:43.003288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214633b-9de3-4ad0-88b7-1bc59c9914b7 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:43.003918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214633b-9de3-4ad0-88b7-1bc59c9914b7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:43.003918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214633b-9de3-4ad0-88b7-1bc59c9914b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:43.025368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2214633b-9de3-4ad0-88b7-1bc59c9914b7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:43.026690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2214633b-9de3-4ad0-88b7-1bc59c9914b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:43.029973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:43.100579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 460/939] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:17:43.375216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec07346-cd1f-4773-a52d-e5b6b6969975 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:43.477393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec07346-cd1f-4773-a52d-e5b6b6969975 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:43.513071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:43.522386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:43.523060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:43.523337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:43.523609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:43.535216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:17:43.541554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:43.542696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:17:43.543899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:43.548328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 480/940] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:43.549213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214633b-9de3-4ad0-88b7-1bc59c9914b7 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:43.654483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214633b-9de3-4ad0-88b7-1bc59c9914b7 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:43.691131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:43.691763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:43.692102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:43.692396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:43.693077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:43.693383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:43.695155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:43.704355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 461/941] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:43.710463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:43.821617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d09d6-30ab-40f8-aa8f-d3df8cdcc03f None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:43.858069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:43.858704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:43.859028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:43.859324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:43.870321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:43.871816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:43.887271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:43.888778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:43.889932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:43.889932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:43.889932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:43.889932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 481/942] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:43.894719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:43.898132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:44.001710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762fb6-f768-4922-a7e6-290ca5da3d65 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:44.036697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:44.037326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:44.037638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:44.037980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:44.038628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:44.038973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:44.040367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:44.053759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 462/943] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:44.059792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:44.107375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:44.171472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8472-c9b1-487e-9f14-9d3740f05c58 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:44.206524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:44.207178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:44.207452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:44.207715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:44.215198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:44.216657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:17:44.228940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:44.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:44.231245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 482/944] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:17:44.236405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:44.305497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:44.354642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bf1c4-17af-40ab-9bfd-774ea26d1627 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:44.398365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:44.399006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:44.399280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:44.399545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:44.400266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:44.400568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:44.401988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:44.427403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 463/945] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Oct 11 13:17:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:44.433551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:44.550104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1de07-6a47-4de2-b903-ed9b85e6bebb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:44.551719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:44.586108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:44.586658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:44.586969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:44.587243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:44.598501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:44.600069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:44.615871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:44.617084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:44.618289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:44.618289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:44.618289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:44.618289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 483/946] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:44.623767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:44.737080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffacf3f-8a0d-48e8-ac26-67d4f3628e16 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:44.760675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:44.777106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:44.777717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:44.778013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:44.778247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:44.778963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:44.779258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:44.780613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:44.792817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 464/947] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:44.798715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:44.906390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088d5a0-247c-4058-8041-68c31d314483 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:44.943265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:44.943920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:44.944161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:44.944558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:44.951442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:44.952917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:17:44.964594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:44.965736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:44.966836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 484/948] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 13:17:44.971757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:45.081252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19d5a0-f400-4dad-8999-9e28dee77740 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:45.116461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2ecd1-07e7-4b2d-99bf-e21d4fb300ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:45.117070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2ecd1-07e7-4b2d-99bf-e21d4fb300ec None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:45.117346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2ecd1-07e7-4b2d-99bf-e21d4fb300ec None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:45.117623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2ecd1-07e7-4b2d-99bf-e21d4fb300ec None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:45.118309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2ecd1-07e7-4b2d-99bf-e21d4fb300ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:45.118612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2ecd1-07e7-4b2d-99bf-e21d4fb300ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:45.120088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2ecd1-07e7-4b2d-99bf-e21d4fb300ec None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:45.134323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 465/949] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:45.140799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:45.157870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:45.251986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aaab2-76c4-4c36-81ba-b2bd42f3d056 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:45.288888 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf381317-ef43-492d-b99b-73a05fa3a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:45.289551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf381317-ef43-492d-b99b-73a05fa3a9d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:45.289822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf381317-ef43-492d-b99b-73a05fa3a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:45.290086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf381317-ef43-492d-b99b-73a05fa3a9d5 None admin] PATH_INFO: `/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/a0085283bb7642b1a37fbd122831289d/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:45.292347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf381317-ef43-492d-b99b-73a05fa3a9d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a9a6f05204b66a90333fa09948687, user_id=a0085283bb7642b1a37fbd122831289d, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:45.293767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf381317-ef43-492d-b99b-73a05fa3a9d5 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:45.307038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 485/950] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Oct 11 13:17:45 2022] PUT /identity/v3/projects/0d6a9a6f05204b66a90333fa09948687/users/a0085283bb7642b1a37fbd122831289d/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:17:47.591033 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ad1a-572f-4443-8d65-e9a981031e82 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:47.591541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ad1a-572f-4443-8d65-e9a981031e82 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:47.591726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ad1a-572f-4443-8d65-e9a981031e82 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:47.593474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 466/951] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:47.599779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2de3-3571-43ab-826f-3490585f09e0 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:47.600350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2de3-3571-43ab-826f-3490585f09e0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:47.600453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2de3-3571-43ab-826f-3490585f09e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:47.621638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-350e2de3-3571-43ab-826f-3490585f09e0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:47.622847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-350e2de3-3571-43ab-826f-3490585f09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:47.705341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 486/952] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:17:48.020201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ad1a-572f-4443-8d65-e9a981031e82 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:48.071596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:48.132739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ad1a-572f-4443-8d65-e9a981031e82 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:48.173583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:48.174252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:48.174573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:48.174871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:48.185696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 13:17:48.190630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:48.191746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:48.192637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 467/953] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Oct 11 13:17:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:48.199003 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e2de3-3571-43ab-826f-3490585f09e0 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:48.203583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:48.304131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e2de3-3571-43ab-826f-3490585f09e0 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:48.344882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:48.345624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:48.345903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:48.346176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:48.346861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:48.347197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:48.348785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:48.358222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 487/954] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Oct 11 13:17:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:48.364191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:48.468039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:48.471300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b7a9-9840-4ec1-aa7d-48f95128683a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:48.507078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:48.507787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:48.508066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:48.508372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:48.519166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:48.520604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:48.535296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:48.536443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:48.537636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:48.537636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:48.537636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:48.537636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 468/955] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:48.543052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:48.615085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:48.655604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4a2a-c46d-420b-b6a2-839332535ca6 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:48.696576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:48.697190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:48.697468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:48.697736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:48.698375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:48.698680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:48.700147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:48.717205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 488/956] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:48.718454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:48.828621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097a7e-8f6f-4e95-abde-26f322810fe7 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:48.868577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:48.869227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:48.869619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:48.870009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:48.878224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:48.879661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 13:17:48.891902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:48.892889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:48.893829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 469/957] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:48.899433 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:49.005263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d529b9e-0585-4e32-9c0b-eab9f40235cb None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:49.035656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:49.050951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:49.051593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:49.052057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:49.052185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:49.052961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:49.053290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:49.055147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:49.075435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 489/958] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Oct 11 13:17:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:17:49.081968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:49.099343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:49.196055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877a64-736f-49b4-8ceb-81277e228bc2 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:49.236690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:49.237406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:49.237794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:49.238064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:49.309602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:49.311245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:49.328493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:49.424558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 470/959] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Oct 11 13:17:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 13:17:49.431231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:49.551699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bfd4f-32ff-4668-b227-000aedaf76be None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:49.589713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:49.590364 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:49.590635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:49.590924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:49.602786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:49.604288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 13:17:49.620085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:49.621582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 13:17:49.622455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 13:17:49.622455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 13:17:49.622455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:49.622455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 490/960] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:49.627701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:49.734157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed925b-2354-4aaa-8c0d-e46ae64aa768 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:49.748953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:49.772884 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:49.773406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:49.773677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:49.773946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:49.774598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:49.774926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:49.776314 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:49.789032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 471/961] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Oct 11 13:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:49.795697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:49.835741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:49.906978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6793-6ef2-413f-a772-5b5335423c2c None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:49.942014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:49.942643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:49.942943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:49.943211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:49.950128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:49.951581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 13:17:49.963146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:49.964218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: ERROR keystone.server.flask.application Oct 11 13:17:49.965120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 491/962] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Oct 11 13:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:49.970258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:50.079700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3ed39-6cf3-4331-8cf5-e8e7e57e3051 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:50.113281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1d2c5-cba8-48c7-af2c-be70b2039efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:50.113805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1d2c5-cba8-48c7-af2c-be70b2039efc None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:50.114074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1d2c5-cba8-48c7-af2c-be70b2039efc None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:50.114337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1d2c5-cba8-48c7-af2c-be70b2039efc None admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:50.115051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1d2c5-cba8-48c7-af2c-be70b2039efc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:50.115351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1d2c5-cba8-48c7-af2c-be70b2039efc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:50.116858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1d2c5-cba8-48c7-af2c-be70b2039efc None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:50.128763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 472/963] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Oct 11 13:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:50.135116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:50.233467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:50.239747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9a0c6-63f1-4989-a2fb-33414928a841 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:50.273943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99076282-8c7f-4235-b069-4dc2514790c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:50.274538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99076282-8c7f-4235-b069-4dc2514790c0 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:50.274810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99076282-8c7f-4235-b069-4dc2514790c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:50.275103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99076282-8c7f-4235-b069-4dc2514790c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:50.275823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99076282-8c7f-4235-b069-4dc2514790c0 None admin] RBAC: Adding query filter params (role.id=66b14ad5013d4a35a57fd140932b8857, scope.project.id=0d6a9a6f05204b66a90333fa09948687, user.id=a0085283bb7642b1a37fbd122831289d) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:50.276131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99076282-8c7f-4235-b069-4dc2514790c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:50.277566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99076282-8c7f-4235-b069-4dc2514790c0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:50.283434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 492/964] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Oct 11 13:17:50 2022] GET /identity/v3/role_assignments?user.id=a0085283bb7642b1a37fbd122831289d&scope.project.id=0d6a9a6f05204b66a90333fa09948687&role.id=66b14ad5013d4a35a57fd140932b8857 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:52.418115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a66d1-70dc-4f03-9c41-6bd2cb48ffd0 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:52.418950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a66d1-70dc-4f03-9c41-6bd2cb48ffd0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:52.418950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a66d1-70dc-4f03-9c41-6bd2cb48ffd0 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:52.421319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 473/965] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:52.429325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce7d8d-2f0e-4e4f-a71b-ebf681f0d896 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:52.429786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce7d8d-2f0e-4e4f-a71b-ebf681f0d896 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:52.429894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce7d8d-2f0e-4e4f-a71b-ebf681f0d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:52.448381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6cce7d8d-2f0e-4e4f-a71b-ebf681f0d896 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:52.449565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6cce7d8d-2f0e-4e4f-a71b-ebf681f0d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:52.522916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 493/966] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 13:17:52.795994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a66d1-70dc-4f03-9c41-6bd2cb48ffd0 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:52.838320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:52.916500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a66d1-70dc-4f03-9c41-6bd2cb48ffd0 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:52.951605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:52.952228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:52.952502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:52.952764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:52.953340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:52.954698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:52.963897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:52.965035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:52.965892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 474/967] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:17:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:52.971252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce7d8d-2f0e-4e4f-a71b-ebf681f0d896 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:53.074926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:53.086509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce7d8d-2f0e-4e4f-a71b-ebf681f0d896 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:53.123831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1215cdc-1d37-45b1-9ef4-71e498483595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:53.124434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1215cdc-1d37-45b1-9ef4-71e498483595 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:53.124708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1215cdc-1d37-45b1-9ef4-71e498483595 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:53.124979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1215cdc-1d37-45b1-9ef4-71e498483595 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:53.125607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1215cdc-1d37-45b1-9ef4-71e498483595 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:53.125916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1215cdc-1d37-45b1-9ef4-71e498483595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:53.127319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1215cdc-1d37-45b1-9ef4-71e498483595 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:53.132620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 494/968] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Oct 11 13:17:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:53.139095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:53.241342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:53.248315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1bdaf-3d3f-4e62-aeec-2230b503daa0 None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:53.285642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826fa9a-6793-48e1-bc7a-a795285b5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:53.286242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826fa9a-6793-48e1-bc7a-a795285b5338 None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:53.286511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826fa9a-6793-48e1-bc7a-a795285b5338 None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:53.286777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826fa9a-6793-48e1-bc7a-a795285b5338 None admin] PATH_INFO: `/v3/services` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:53.287434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826fa9a-6793-48e1-bc7a-a795285b5338 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:53.287822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826fa9a-6793-48e1-bc7a-a795285b5338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:53.289294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826fa9a-6793-48e1-bc7a-a795285b5338 None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:53.294615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 475/969] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Oct 11 13:17:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:55.391410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b076ab-9956-483f-9486-4213f644bf97 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:55.391962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b076ab-9956-483f-9486-4213f644bf97 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:55.391962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b076ab-9956-483f-9486-4213f644bf97 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:55.393291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 495/970] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:55.400019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071c1b6-ada3-4245-99ff-061e78d17cc5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:55.400685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071c1b6-ada3-4245-99ff-061e78d17cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:55.400913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071c1b6-ada3-4245-99ff-061e78d17cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:55.430905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2071c1b6-ada3-4245-99ff-061e78d17cc5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:55.432119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2071c1b6-ada3-4245-99ff-061e78d17cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:55.503229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 476/971] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:17:55.772591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b076ab-9956-483f-9486-4213f644bf97 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:55.887399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b076ab-9956-483f-9486-4213f644bf97 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:55.923305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463b93e-a1f5-45d5-9c73-d8c84a58dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:55.923906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463b93e-a1f5-45d5-9c73-d8c84a58dba0 None admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:55.924185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463b93e-a1f5-45d5-9c73-d8c84a58dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:55.924461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463b93e-a1f5-45d5-9c73-d8c84a58dba0 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:55.925104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463b93e-a1f5-45d5-9c73-d8c84a58dba0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:55.926478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463b93e-a1f5-45d5-9c73-d8c84a58dba0 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:55.944068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 496/972] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Oct 11 13:17:55 2022] POST /identity/v3/services => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:17:58.208320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac29d6-2f97-48d8-a6e2-0ae2e31298c4 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:58.208929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac29d6-2f97-48d8-a6e2-0ae2e31298c4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:58.208929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac29d6-2f97-48d8-a6e2-0ae2e31298c4 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:58.210343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 477/973] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:17:58.219211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5d46-b4c6-480c-86b3-334dceef4315 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:58.219929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5d46-b4c6-480c-86b3-334dceef4315 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:58.220115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5d46-b4c6-480c-86b3-334dceef4315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:58.241223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-8c6f5d46-b4c6-480c-86b3-334dceef4315 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:17:58.242413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8c6f5d46-b4c6-480c-86b3-334dceef4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:17:58.251847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:58.318130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 497/974] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:17:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:17:58.580613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac29d6-2f97-48d8-a6e2-0ae2e31298c4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:58.680739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:58.692814 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac29d6-2f97-48d8-a6e2-0ae2e31298c4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:58.728562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:58.729170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:58.729439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:58.729704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:58.730274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:58.731653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:17:58.740868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:17:58.743115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:17:58.744205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 478/975] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:17:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:17:58.748133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5d46-b4c6-480c-86b3-334dceef4315 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:58.846776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5d46-b4c6-480c-86b3-334dceef4315 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:58.881649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:58.882241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:58.882512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:58.882778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:58.883428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:58.883725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:58.885166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:58.890258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 498/976] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Oct 11 13:17:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:58.896349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:59.003828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c2061-8163-4e86-bca3-add731a3276a None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:59.044538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c652950-53fc-44b3-9fad-0f200faae0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:59.045237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c652950-53fc-44b3-9fad-0f200faae0ed None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:59.045519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c652950-53fc-44b3-9fad-0f200faae0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:59.045902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c652950-53fc-44b3-9fad-0f200faae0ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:59.046785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c652950-53fc-44b3-9fad-0f200faae0ed None admin] RBAC: Adding query filter params (interface=public, service_id=da298a27b948402994ae1f4bb4b36e6f, region_id=RegionOne) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:17:59.047202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c652950-53fc-44b3-9fad-0f200faae0ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:59.048857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c652950-53fc-44b3-9fad-0f200faae0ed None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:59.059562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 479/977] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Oct 11 13:17:58 2022] GET /identity/v3/endpoints?service_id=da298a27b948402994ae1f4bb4b36e6f&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:17:59.061080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:17:59.065643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:17:59.169950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfa48-5f28-4c19-834d-fb951e35cf69 None admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:17:59.213758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f1cd4-e2fd-40f5-806a-b0d5c22d55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:17:59.214358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f1cd4-e2fd-40f5-806a-b0d5c22d55a4 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:17:59.214630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f1cd4-e2fd-40f5-806a-b0d5c22d55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:17:59.214918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f1cd4-e2fd-40f5-806a-b0d5c22d55a4 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:17:59.215514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f1cd4-e2fd-40f5-806a-b0d5c22d55a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:17:59.216880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f1cd4-e2fd-40f5-806a-b0d5c22d55a4 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:17:59.223685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 499/978] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Oct 11 13:17:59 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:18:01.311372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150c174-8d3f-406a-9a33-f795ff7c77a9 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:18:01.312244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150c174-8d3f-406a-9a33-f795ff7c77a9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:18:01.312244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150c174-8d3f-406a-9a33-f795ff7c77a9 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:18:01.314337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 480/979] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:18:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:18:01.322574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f0deb-cffc-4524-ac96-a5849ce112d4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:18:01.323333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f0deb-cffc-4524-ac96-a5849ce112d4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:18:01.323506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f0deb-cffc-4524-ac96-a5849ce112d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:18:01.346149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-829f0deb-cffc-4524-ac96-a5849ce112d4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:18:01.347377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-829f0deb-cffc-4524-ac96-a5849ce112d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:18:01.415543 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:18:01.422139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 500/980] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:18:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 13:18:01.685066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150c174-8d3f-406a-9a33-f795ff7c77a9 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:18:01.707459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:18:01.792157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150c174-8d3f-406a-9a33-f795ff7c77a9 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:18:01.827593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:18:01.828219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:18:01.828487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:18:01.828751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] PATH_INFO: `/v3/services/placement` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:18:01.829360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:18:01.830709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 13:18:01.840383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 13:18:01.841546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application with Lock( Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self._enter() Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application return self.creator() Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application created_value = creator( Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: ERROR keystone.server.flask.application Oct 11 13:18:01.842394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 481/981] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Oct 11 13:18:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 13:18:01.848331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f0deb-cffc-4524-ac96-a5849ce112d4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:18:01.955143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f0deb-cffc-4524-ac96-a5849ce112d4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:18:01.995641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d432bb-f896-4a54-9c4a-aad2a9056d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:18:01.996263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d432bb-f896-4a54-9c4a-aad2a9056d82 None admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:18:01.996547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d432bb-f896-4a54-9c4a-aad2a9056d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:18:01.996829 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d432bb-f896-4a54-9c4a-aad2a9056d82 None admin] PATH_INFO: `/v3/services` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:18:01.997457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d432bb-f896-4a54-9c4a-aad2a9056d82 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:18:01.997758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d432bb-f896-4a54-9c4a-aad2a9056d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:18:01.999266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d432bb-f896-4a54-9c4a-aad2a9056d82 None admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:18:02.005292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 501/982] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Oct 11 13:18:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:18:02.012572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:18:02.118612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:18:02.141522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c768330-951b-407e-9c87-420bd3658dff None admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:18:02.177569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7558-a366-42ff-9bd9-8359db47d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:18:02.178238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7558-a366-42ff-9bd9-8359db47d03b None admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:18:02.178511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7558-a366-42ff-9bd9-8359db47d03b None admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:18:02.178778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7558-a366-42ff-9bd9-8359db47d03b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:18:02.179493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e7558-a366-42ff-9bd9-8359db47d03b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:18:02.180877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e7558-a366-42ff-9bd9-8359db47d03b None admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:18:02.203780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 482/983] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:18:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:18:12.001727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=69 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:18:12.198644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:05.639473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0fd0-4144-47c0-85f9-9aeac55edb2a None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:05.639949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0fd0-4144-47c0-85f9-9aeac55edb2a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:05.640025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0fd0-4144-47c0-85f9-9aeac55edb2a None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:05.646675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85801-46f8-4e97-bb6c-300354ca99f0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:05.647276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85801-46f8-4e97-bb6c-300354ca99f0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:05.647276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85801-46f8-4e97-bb6c-300354ca99f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:05.652019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 502/984] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:05.774111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f8a85801-46f8-4e97-bb6c-300354ca99f0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:05.775352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f8a85801-46f8-4e97-bb6c-300354ca99f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:05.911099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 483/985] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:19:06.203071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78ded6-a548-499b-af16-cd50d4f3016f None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:06.203378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78ded6-a548-499b-af16-cd50d4f3016f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:06.203646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78ded6-a548-499b-af16-cd50d4f3016f None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:06.205031 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 503/986] 10.222.0.16 () {54 vars in 964 bytes} [Tue Oct 11 13:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:06.211699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730fa9-6101-4bba-9f80-6b54e2cd2512 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:06.211982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730fa9-6101-4bba-9f80-6b54e2cd2512 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:06.212254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730fa9-6101-4bba-9f80-6b54e2cd2512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:06.302372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-64730fa9-6101-4bba-9f80-6b54e2cd2512 None None] MFA Rules not processed for user `ed8635b4ce034605bcce301f3f98e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:06.303679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-64730fa9-6101-4bba-9f80-6b54e2cd2512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:06.342085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:06.396451 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 484/987] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Oct 11 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:06.405666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78ded6-a548-499b-af16-cd50d4f3016f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:06.407429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2e78ded6-a548-499b-af16-cd50d4f3016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:06.518732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78ded6-a548-499b-af16-cd50d4f3016f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:06.597594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f28c-8249-4ff5-8ead-38d1b4a4d93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:06.598110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f28c-8249-4ff5-8ead-38d1b4a4d93a service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:06.598384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f28c-8249-4ff5-8ead-38d1b4a4d93a service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:06.598651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f28c-8249-4ff5-8ead-38d1b4a4d93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:06.600300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1946f28c-8249-4ff5-8ead-38d1b4a4d93a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:06.661142 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:06.720779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946f28c-8249-4ff5-8ead-38d1b4a4d93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:06.722421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946f28c-8249-4ff5-8ead-38d1b4a4d93a service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:06.742249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 504/988] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:09.159311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554379b-ed10-4de1-aa51-3b84650ace98 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:09.159892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554379b-ed10-4de1-aa51-3b84650ace98 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:09.159892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554379b-ed10-4de1-aa51-3b84650ace98 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:09.161206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 485/989] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:09.166662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4dde7-1a5e-4c9b-9556-a6c4da825508 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:09.167138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4dde7-1a5e-4c9b-9556-a6c4da825508 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:09.167360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4dde7-1a5e-4c9b-9556-a6c4da825508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:09.239482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d8f4dde7-1a5e-4c9b-9556-a6c4da825508 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:09.240600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d8f4dde7-1a5e-4c9b-9556-a6c4da825508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:09.351921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 505/990] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:09.632941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554379b-ed10-4de1-aa51-3b84650ace98 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:09.635462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4554379b-ed10-4de1-aa51-3b84650ace98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:09.748895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554379b-ed10-4de1-aa51-3b84650ace98 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:09.827893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:09.830392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039fdf6-2e84-4ebf-b576-3b7a07ae9368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:09.831040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039fdf6-2e84-4ebf-b576-3b7a07ae9368 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:09.831318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039fdf6-2e84-4ebf-b576-3b7a07ae9368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:09.831588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039fdf6-2e84-4ebf-b576-3b7a07ae9368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:09.834077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3039fdf6-2e84-4ebf-b576-3b7a07ae9368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:09.945760 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039fdf6-2e84-4ebf-b576-3b7a07ae9368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:09.947214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039fdf6-2e84-4ebf-b576-3b7a07ae9368 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:09.965616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 486/991] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:12.400515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408906-2c8d-4404-8360-f039c8cf2981 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:12.401385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408906-2c8d-4404-8360-f039c8cf2981 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:12.401385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408906-2c8d-4404-8360-f039c8cf2981 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:12.403713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 506/992] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:12.412500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d94f3-0704-4dda-b810-2f7b98ee87f4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:12.413091 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d94f3-0704-4dda-b810-2f7b98ee87f4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:12.413231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d94f3-0704-4dda-b810-2f7b98ee87f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:12.486447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a24d94f3-0704-4dda-b810-2f7b98ee87f4 None None] MFA Rules not processed for user `0e353a37c7654e15b9756130a532656e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:12.488279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a24d94f3-0704-4dda-b810-2f7b98ee87f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:12.557411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:12.608132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 487/993] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:12.909439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d591-7fc1-4dc4-9d66-21e55465b935 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:12.909684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d591-7fc1-4dc4-9d66-21e55465b935 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:12.909971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d591-7fc1-4dc4-9d66-21e55465b935 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:12.911387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 507/994] 10.222.0.16 () {54 vars in 964 bytes} [Tue Oct 11 13:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:12.918733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b41cd-dd1d-4a68-b99c-c3b8b9de7442 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:12.919157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b41cd-dd1d-4a68-b99c-c3b8b9de7442 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:12.919510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b41cd-dd1d-4a68-b99c-c3b8b9de7442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:13.002276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3c2b41cd-dd1d-4a68-b99c-c3b8b9de7442 None None] MFA Rules not processed for user `ed8635b4ce034605bcce301f3f98e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:13.003511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3c2b41cd-dd1d-4a68-b99c-c3b8b9de7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:13.081367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 488/995] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Oct 11 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:13.091095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d591-7fc1-4dc4-9d66-21e55465b935 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:13.093660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f553d591-7fc1-4dc4-9d66-21e55465b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:13.107056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:13.201299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d591-7fc1-4dc4-9d66-21e55465b935 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:13.277743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190faeb-a51c-4076-81ba-d64a240252eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:13.278332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190faeb-a51c-4076-81ba-d64a240252eb service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:13.278603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190faeb-a51c-4076-81ba-d64a240252eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:13.278859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190faeb-a51c-4076-81ba-d64a240252eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:13.280460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7190faeb-a51c-4076-81ba-d64a240252eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:13.348201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:13.397641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190faeb-a51c-4076-81ba-d64a240252eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:13.399099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190faeb-a51c-4076-81ba-d64a240252eb service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:13.417166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 508/996] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:16.451408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbafe-4ad4-4c7f-aa68-51a888fe8e87 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:16.451956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbafe-4ad4-4c7f-aa68-51a888fe8e87 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:16.451956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbafe-4ad4-4c7f-aa68-51a888fe8e87 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:16.453347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 489/997] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:16.458803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391f7d5-91ce-4a71-9705-40e59a2e40d1 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:16.459236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391f7d5-91ce-4a71-9705-40e59a2e40d1 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:16.459361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391f7d5-91ce-4a71-9705-40e59a2e40d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:16.528195 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3391f7d5-91ce-4a71-9705-40e59a2e40d1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:16.529400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3391f7d5-91ce-4a71-9705-40e59a2e40d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:16.627661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 509/998] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:16.909531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dbafe-4ad4-4c7f-aa68-51a888fe8e87 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:16.911118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5f9dbafe-4ad4-4c7f-aa68-51a888fe8e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:16.965808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:17.027926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dbafe-4ad4-4c7f-aa68-51a888fe8e87 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:17.104382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54a6b1-560c-4508-912f-064e7eac5798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:17.104982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54a6b1-560c-4508-912f-064e7eac5798 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:17.105256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54a6b1-560c-4508-912f-064e7eac5798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:17.105519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54a6b1-560c-4508-912f-064e7eac5798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:17.107142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0a54a6b1-560c-4508-912f-064e7eac5798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:17.216552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:17.230935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54a6b1-560c-4508-912f-064e7eac5798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:17.232370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54a6b1-560c-4508-912f-064e7eac5798 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:17.250325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 490/999] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:20.131200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3b95-506e-4ab3-94b1-d6c84360aa84 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:20.131939 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3b95-506e-4ab3-94b1-d6c84360aa84 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:20.131939 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3b95-506e-4ab3-94b1-d6c84360aa84 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:20.133357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 510/1000] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:20.138641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c045e-b2cd-4d8c-b475-470c3574f44f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:20.139083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c045e-b2cd-4d8c-b475-470c3574f44f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:20.139192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c045e-b2cd-4d8c-b475-470c3574f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:20.219362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f41c045e-b2cd-4d8c-b475-470c3574f44f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:20.220793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f41c045e-b2cd-4d8c-b475-470c3574f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:20.328873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 491/1001] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:20.610010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3b95-506e-4ab3-94b1-d6c84360aa84 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:20.611580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-aaad3b95-506e-4ab3-94b1-d6c84360aa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:20.632841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:20.722034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3b95-506e-4ab3-94b1-d6c84360aa84 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:20.801144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329da0-c626-42a9-a24a-2b0979638bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:20.801746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329da0-c626-42a9-a24a-2b0979638bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:20.802018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329da0-c626-42a9-a24a-2b0979638bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:20.802282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329da0-c626-42a9-a24a-2b0979638bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:20.804006 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-59329da0-c626-42a9-a24a-2b0979638bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:20.880127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:20.920345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329da0-c626-42a9-a24a-2b0979638bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:20.921796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329da0-c626-42a9-a24a-2b0979638bc4 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:20.940320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 511/1002] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:23.112016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975370b0-51a8-4b54-bc73-514ddbcea298 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:23.112543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975370b0-51a8-4b54-bc73-514ddbcea298 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:23.112543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975370b0-51a8-4b54-bc73-514ddbcea298 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:23.113908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 492/1003] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:23.119365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e1f1-5372-4e20-a42a-f59d49a797ed None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:23.119802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e1f1-5372-4e20-a42a-f59d49a797ed None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:23.119885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e1f1-5372-4e20-a42a-f59d49a797ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:23.189195 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3aa2e1f1-5372-4e20-a42a-f59d49a797ed None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:23.192329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3aa2e1f1-5372-4e20-a42a-f59d49a797ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:23.301341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 512/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:23.581525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975370b0-51a8-4b54-bc73-514ddbcea298 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:23.583101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-975370b0-51a8-4b54-bc73-514ddbcea298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:23.646408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:23.690512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975370b0-51a8-4b54-bc73-514ddbcea298 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:23.768936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fafe7-d243-4566-9e8a-3d6124397588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:23.769542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fafe7-d243-4566-9e8a-3d6124397588 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:23.769819 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fafe7-d243-4566-9e8a-3d6124397588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:23.770087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fafe7-d243-4566-9e8a-3d6124397588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:23.771729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-970fafe7-d243-4566-9e8a-3d6124397588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:23.884323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:23.887283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fafe7-d243-4566-9e8a-3d6124397588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:23.889369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fafe7-d243-4566-9e8a-3d6124397588 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:23.907485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 493/1005] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:26.093324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb9b5-d1cc-499e-bb6b-6bd8b0c79633 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:26.093814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb9b5-d1cc-499e-bb6b-6bd8b0c79633 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:26.093814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb9b5-d1cc-499e-bb6b-6bd8b0c79633 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:26.095201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 513/1006] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:26.100827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d050a20-26fb-4a13-b048-017b143734b1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:26.101229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d050a20-26fb-4a13-b048-017b143734b1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:26.101357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d050a20-26fb-4a13-b048-017b143734b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:26.172241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2d050a20-26fb-4a13-b048-017b143734b1 None None] MFA Rules not processed for user `0e353a37c7654e15b9756130a532656e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:26.173434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2d050a20-26fb-4a13-b048-017b143734b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:26.272839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 494/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:26.552301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb9b5-d1cc-499e-bb6b-6bd8b0c79633 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:26.553892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3c2bb9b5-d1cc-499e-bb6b-6bd8b0c79633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:26.587343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:26.664439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb9b5-d1cc-499e-bb6b-6bd8b0c79633 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:26.743922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac1917-2037-4a9b-a211-33dccb731a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:26.744524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac1917-2037-4a9b-a211-33dccb731a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:26.744801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac1917-2037-4a9b-a211-33dccb731a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:26.745068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac1917-2037-4a9b-a211-33dccb731a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:26.746668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-40ac1917-2037-4a9b-a211-33dccb731a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:26.827702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:26.861036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac1917-2037-4a9b-a211-33dccb731a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:26.862500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac1917-2037-4a9b-a211-33dccb731a4f service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:26.881849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 514/1008] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:29.294624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acf49-4a8b-4086-9e96-0972832ddc45 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:29.295624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acf49-4a8b-4086-9e96-0972832ddc45 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:29.295624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acf49-4a8b-4086-9e96-0972832ddc45 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:29.297514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 495/1009] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:29.304097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24cc0e-a93c-4a2a-9cf4-a6c32f7c5d6f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:29.304564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24cc0e-a93c-4a2a-9cf4-a6c32f7c5d6f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:29.304674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24cc0e-a93c-4a2a-9cf4-a6c32f7c5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:29.373543 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1c24cc0e-a93c-4a2a-9cf4-a6c32f7c5d6f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:29.374753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1c24cc0e-a93c-4a2a-9cf4-a6c32f7c5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:29.474678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 515/1010] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:29.754770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30acf49-4a8b-4086-9e96-0972832ddc45 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:29.757223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c30acf49-4a8b-4086-9e96-0972832ddc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:29.836603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:29.881864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30acf49-4a8b-4086-9e96-0972832ddc45 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:29.961470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777c3ea-abda-4a1b-96b2-69d067b6b4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:29.962068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777c3ea-abda-4a1b-96b2-69d067b6b4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:29.962335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777c3ea-abda-4a1b-96b2-69d067b6b4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:29.962624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777c3ea-abda-4a1b-96b2-69d067b6b4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:29.964217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8777c3ea-abda-4a1b-96b2-69d067b6b4c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:30.078053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777c3ea-abda-4a1b-96b2-69d067b6b4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:30.079442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777c3ea-abda-4a1b-96b2-69d067b6b4c2 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:30.089516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:30.099073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 496/1011] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:32.265071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a6e5-c29a-45f3-9474-5e61ae75202e None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:32.265626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a6e5-c29a-45f3-9474-5e61ae75202e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:32.265626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a6e5-c29a-45f3-9474-5e61ae75202e None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:32.266972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 516/1012] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:32.274902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886babab-8609-4d03-ada3-d60bf4d53b22 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:32.275405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886babab-8609-4d03-ada3-d60bf4d53b22 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:32.275502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886babab-8609-4d03-ada3-d60bf4d53b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:32.354952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-886babab-8609-4d03-ada3-d60bf4d53b22 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:32.356171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-886babab-8609-4d03-ada3-d60bf4d53b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:32.455721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 497/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:32.738471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5a6e5-c29a-45f3-9474-5e61ae75202e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:32.740069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-13a5a6e5-c29a-45f3-9474-5e61ae75202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:32.790498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:32.868972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5a6e5-c29a-45f3-9474-5e61ae75202e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:32.951221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7b91f-de3f-48e5-b441-806be58688f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:32.951844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b91f-de3f-48e5-b441-806be58688f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:32.952090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b91f-de3f-48e5-b441-806be58688f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:32.952352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b91f-de3f-48e5-b441-806be58688f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:32.953946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-77c7b91f-de3f-48e5-b441-806be58688f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:33.044310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:33.073706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b91f-de3f-48e5-b441-806be58688f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:33.075198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b91f-de3f-48e5-b441-806be58688f0 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:33.093724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 517/1014] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:19:35.651031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b12dd-d4fd-49c3-91fc-50fbbbadf538 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:35.651558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b12dd-d4fd-49c3-91fc-50fbbbadf538 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:35.651558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b12dd-d4fd-49c3-91fc-50fbbbadf538 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:35.653580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 498/1015] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:35.662431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0dacd-9948-4631-99ff-c73b686e5443 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:35.663029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0dacd-9948-4631-99ff-c73b686e5443 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:35.663294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0dacd-9948-4631-99ff-c73b686e5443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:35.732258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2af0dacd-9948-4631-99ff-c73b686e5443 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:35.734024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2af0dacd-9948-4631-99ff-c73b686e5443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:35.846693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 518/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:36.128579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b12dd-d4fd-49c3-91fc-50fbbbadf538 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:36.130131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a26b12dd-d4fd-49c3-91fc-50fbbbadf538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:36.208934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:36.243885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b12dd-d4fd-49c3-91fc-50fbbbadf538 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:36.324360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e2383-fdba-47b9-87f5-621a6f4c88fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:36.324984 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e2383-fdba-47b9-87f5-621a6f4c88fb service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:36.325263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e2383-fdba-47b9-87f5-621a6f4c88fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:36.325535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e2383-fdba-47b9-87f5-621a6f4c88fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:36.327200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a42e2383-fdba-47b9-87f5-621a6f4c88fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:36.449032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e2383-fdba-47b9-87f5-621a6f4c88fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:36.450477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e2383-fdba-47b9-87f5-621a6f4c88fb service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:36.471605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 499/1017] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:19:40.597892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3d71-8dc0-491a-8879-efb1fda206a5 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:40.598475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3d71-8dc0-491a-8879-efb1fda206a5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:40.598475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3d71-8dc0-491a-8879-efb1fda206a5 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:40.599786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 519/1018] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:40.605280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c2ff-b733-4b43-b217-93d92df9e498 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:40.605704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c2ff-b733-4b43-b217-93d92df9e498 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:40.605932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c2ff-b733-4b43-b217-93d92df9e498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:40.611698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:40.676110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8fd1c2ff-b733-4b43-b217-93d92df9e498 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:40.677234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8fd1c2ff-b733-4b43-b217-93d92df9e498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:40.778674 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 500/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:41.060970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b3d71-8dc0-491a-8879-efb1fda206a5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:41.062556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8b7b3d71-8dc0-491a-8879-efb1fda206a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:41.114425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:41.172123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b3d71-8dc0-491a-8879-efb1fda206a5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:41.247245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72421440-3c52-47d5-b4fc-fa281e2a93bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:41.247756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421440-3c52-47d5-b4fc-fa281e2a93bc service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:41.248027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421440-3c52-47d5-b4fc-fa281e2a93bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:41.248292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421440-3c52-47d5-b4fc-fa281e2a93bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:41.249877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-72421440-3c52-47d5-b4fc-fa281e2a93bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:41.351011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:41.369550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421440-3c52-47d5-b4fc-fa281e2a93bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:41.371031 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421440-3c52-47d5-b4fc-fa281e2a93bc service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:41.390298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 520/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:44.261116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b6d8-b001-4e19-9b18-86504301b617 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:44.261672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b6d8-b001-4e19-9b18-86504301b617 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:44.261672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b6d8-b001-4e19-9b18-86504301b617 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:44.263042 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 501/1021] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:44.268434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e765-8037-4fed-8528-9e40af97df52 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:44.268893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e765-8037-4fed-8528-9e40af97df52 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:44.268985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e765-8037-4fed-8528-9e40af97df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:44.342303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-b623e765-8037-4fed-8528-9e40af97df52 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:44.343554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b623e765-8037-4fed-8528-9e40af97df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:44.452365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 521/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:44.735878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b6d8-b001-4e19-9b18-86504301b617 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:44.737510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2d70b6d8-b001-4e19-9b18-86504301b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:44.828769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:44.847714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b6d8-b001-4e19-9b18-86504301b617 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:44.925240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9299646-f927-4bb2-ac07-1337cc505da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:44.925849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299646-f927-4bb2-ac07-1337cc505da4 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:44.926123 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299646-f927-4bb2-ac07-1337cc505da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:44.926391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299646-f927-4bb2-ac07-1337cc505da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:44.928024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b9299646-f927-4bb2-ac07-1337cc505da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:45.073079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9299646-f927-4bb2-ac07-1337cc505da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:45.074501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9299646-f927-4bb2-ac07-1337cc505da4 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:45.099694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 502/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:49.146112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01506c59-e61e-420c-9d5c-ccc08c0324da None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:49.147139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01506c59-e61e-420c-9d5c-ccc08c0324da None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:49.147524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01506c59-e61e-420c-9d5c-ccc08c0324da None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:49.149024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 522/1024] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:49.154716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed950c-676f-4493-bd6f-acfdba902f00 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:49.155258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed950c-676f-4493-bd6f-acfdba902f00 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:49.155258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed950c-676f-4493-bd6f-acfdba902f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:49.171886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:49.227352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-31ed950c-676f-4493-bd6f-acfdba902f00 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:49.228591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-31ed950c-676f-4493-bd6f-acfdba902f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:49.336451 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 503/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:49.619151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01506c59-e61e-420c-9d5c-ccc08c0324da None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:19:49.621600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-01506c59-e61e-420c-9d5c-ccc08c0324da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:49.692071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:49.743770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01506c59-e61e-420c-9d5c-ccc08c0324da None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:19:49.827747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7869-b1f1-40f8-84b3-dedf5a765804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:19:49.828347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7869-b1f1-40f8-84b3-dedf5a765804 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:49.828625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7869-b1f1-40f8-84b3-dedf5a765804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:49.828887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7869-b1f1-40f8-84b3-dedf5a765804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:49.830474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-84ef7869-b1f1-40f8-84b3-dedf5a765804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:49.948919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:49.953257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef7869-b1f1-40f8-84b3-dedf5a765804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:19:49.954756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef7869-b1f1-40f8-84b3-dedf5a765804 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:19:49.973756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 523/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:19:54.847149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3bb6-9e61-4c21-b00b-652cf721fe33 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:54.847605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3bb6-9e61-4c21-b00b-652cf721fe33 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:54.847605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3bb6-9e61-4c21-b00b-652cf721fe33 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:54.849394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 504/1027] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:54.854749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb134f6-0e59-4d96-8ace-087682ec819d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:54.855290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb134f6-0e59-4d96-8ace-087682ec819d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:54.855290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb134f6-0e59-4d96-8ace-087682ec819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:54.977427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-feb134f6-0e59-4d96-8ace-087682ec819d None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:54.978632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-feb134f6-0e59-4d96-8ace-087682ec819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:55.092038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 524/1028] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:19:59.159311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d636b9-3eea-496e-bb09-17e03f247a30 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:59.159929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d636b9-3eea-496e-bb09-17e03f247a30 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:59.159929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d636b9-3eea-496e-bb09-17e03f247a30 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:59.161345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 505/1029] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:19:59.166570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdfc30-8162-446f-94d3-b76aa4eddd57 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:19:59.167522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdfc30-8162-446f-94d3-b76aa4eddd57 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:19:59.168039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdfc30-8162-446f-94d3-b76aa4eddd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:19:59.230459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:59.257162 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d9fdfc30-8162-446f-94d3-b76aa4eddd57 None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:19:59.258678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d9fdfc30-8162-446f-94d3-b76aa4eddd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:19:59.334371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=59 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:59.391445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 525/1030] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:19:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:00.898960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746583c-8e3b-419f-b979-36e1e45066b2 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:00.899535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746583c-8e3b-419f-b979-36e1e45066b2 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:00.899535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746583c-8e3b-419f-b979-36e1e45066b2 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:00.900919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 506/1031] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:00.906224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00656e67-336e-4ddd-8281-d5e9ea1f3d14 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:00.906649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00656e67-336e-4ddd-8281-d5e9ea1f3d14 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:00.906774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00656e67-336e-4ddd-8281-d5e9ea1f3d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:00.984904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-00656e67-336e-4ddd-8281-d5e9ea1f3d14 None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:00.986098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-00656e67-336e-4ddd-8281-d5e9ea1f3d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:01.031639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:01.096480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 526/1032] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:04.652340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b07dd9-105e-4960-a4aa-34e0b5628645 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:04.652886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b07dd9-105e-4960-a4aa-34e0b5628645 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:04.652886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b07dd9-105e-4960-a4aa-34e0b5628645 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:04.654373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 507/1033] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:04.659804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126b67-0f7b-4135-a28e-d85729196fe8 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:04.660238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126b67-0f7b-4135-a28e-d85729196fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:04.660315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126b67-0f7b-4135-a28e-d85729196fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:04.725692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d0126b67-0f7b-4135-a28e-d85729196fe8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:04.726934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d0126b67-0f7b-4135-a28e-d85729196fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:04.827722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 527/1034] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:05.124675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a320eb-4032-4a10-a499-c76ba1d63944 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:05.125310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a320eb-4032-4a10-a499-c76ba1d63944 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:05.125804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a320eb-4032-4a10-a499-c76ba1d63944 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:05.127370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 508/1035] 10.222.0.16 () {54 vars in 961 bytes} [Tue Oct 11 13:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:05.135124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3800a1-e856-4538-aefa-cd037e46bd6e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:05.135458 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3800a1-e856-4538-aefa-cd037e46bd6e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:05.135684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3800a1-e856-4538-aefa-cd037e46bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:05.157151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:05.222653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2c3800a1-e856-4538-aefa-cd037e46bd6e None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:05.224100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2c3800a1-e856-4538-aefa-cd037e46bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:05.357153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 528/1036] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Oct 11 13:20:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:05.365634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a320eb-4032-4a10-a499-c76ba1d63944 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:05.367321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-70a320eb-4032-4a10-a499-c76ba1d63944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:05.518252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a320eb-4032-4a10-a499-c76ba1d63944 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:05.594363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:05.635911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d68ea-8c56-4ac3-805b-75445831d167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:05.636515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d68ea-8c56-4ac3-805b-75445831d167 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:05.636786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d68ea-8c56-4ac3-805b-75445831d167 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:05.637050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d68ea-8c56-4ac3-805b-75445831d167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:05.638613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2a5d68ea-8c56-4ac3-805b-75445831d167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:05.739139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d68ea-8c56-4ac3-805b-75445831d167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:05.740711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d68ea-8c56-4ac3-805b-75445831d167 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:05.760307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 509/1037] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:08.116375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09f4a-cd31-4728-be68-7a0b3f75ca4e None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:08.116785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09f4a-cd31-4728-be68-7a0b3f75ca4e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:08.116993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09f4a-cd31-4728-be68-7a0b3f75ca4e None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:08.118232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 529/1038] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:08.125301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a380-bb67-42a4-8e1f-2ded94d73789 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:08.125678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a380-bb67-42a4-8e1f-2ded94d73789 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:08.126501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a380-bb67-42a4-8e1f-2ded94d73789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:08.197520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-ce64a380-bb67-42a4-8e1f-2ded94d73789 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:08.198712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ce64a380-bb67-42a4-8e1f-2ded94d73789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:08.239746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:08.303615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 510/1039] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:08.591431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da09f4a-cd31-4728-be68-7a0b3f75ca4e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:08.592955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7da09f4a-cd31-4728-be68-7a0b3f75ca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:08.663383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:08.768052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da09f4a-cd31-4728-be68-7a0b3f75ca4e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:08.898024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a03086-2ac4-4442-8bc8-6efd00e57ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:08.898659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03086-2ac4-4442-8bc8-6efd00e57ec1 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:08.899086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03086-2ac4-4442-8bc8-6efd00e57ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:08.899361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03086-2ac4-4442-8bc8-6efd00e57ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:08.900959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a8a03086-2ac4-4442-8bc8-6efd00e57ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:08.924774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:08.993080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a03086-2ac4-4442-8bc8-6efd00e57ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:08.994677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a03086-2ac4-4442-8bc8-6efd00e57ec1 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:09.013495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 530/1040] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:11.466986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74b6b-1e88-45a9-8fa8-d6f09b27ed84 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:11.467560 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74b6b-1e88-45a9-8fa8-d6f09b27ed84 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:11.467717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74b6b-1e88-45a9-8fa8-d6f09b27ed84 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:11.469452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 511/1041] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:11.474654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4115b48-fd30-49c2-adb8-1cde762aa1db None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:11.475140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4115b48-fd30-49c2-adb8-1cde762aa1db None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:11.475228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4115b48-fd30-49c2-adb8-1cde762aa1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:11.545078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a4115b48-fd30-49c2-adb8-1cde762aa1db None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:11.546282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a4115b48-fd30-49c2-adb8-1cde762aa1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:11.645698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:11.654878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 531/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:11.938575 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977893b8-7ae1-423b-91e7-a9d50540c40a None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:11.938881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977893b8-7ae1-423b-91e7-a9d50540c40a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:11.939154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977893b8-7ae1-423b-91e7-a9d50540c40a None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:11.940953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 512/1043] 10.222.0.16 () {54 vars in 961 bytes} [Tue Oct 11 13:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:11.946599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd6ed-df59-46d3-aa19-a7e35226747b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:11.946997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd6ed-df59-46d3-aa19-a7e35226747b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:11.947330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd6ed-df59-46d3-aa19-a7e35226747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:12.027221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c49dd6ed-df59-46d3-aa19-a7e35226747b None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:12.028559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c49dd6ed-df59-46d3-aa19-a7e35226747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:12.152343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 532/1044] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Oct 11 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:12.160832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977893b8-7ae1-423b-91e7-a9d50540c40a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:12.162446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-977893b8-7ae1-423b-91e7-a9d50540c40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:12.323439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977893b8-7ae1-423b-91e7-a9d50540c40a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:12.346768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:12.450503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f00fb-2242-47e9-99bd-77c5aebf17a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:12.451149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f00fb-2242-47e9-99bd-77c5aebf17a2 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:12.451450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f00fb-2242-47e9-99bd-77c5aebf17a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:12.451727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f00fb-2242-47e9-99bd-77c5aebf17a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:12.453336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-362f00fb-2242-47e9-99bd-77c5aebf17a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:12.558515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f00fb-2242-47e9-99bd-77c5aebf17a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:12.560132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f00fb-2242-47e9-99bd-77c5aebf17a2 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:12.579383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 513/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:12.633689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762335be-e844-4c6c-98cd-6e70a7d553cc None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:12.634224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762335be-e844-4c6c-98cd-6e70a7d553cc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:12.634542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762335be-e844-4c6c-98cd-6e70a7d553cc None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:12.636145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 533/1046] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:12.641584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca552dc-b5d5-410e-a155-7917505fd927 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:12.641934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca552dc-b5d5-410e-a155-7917505fd927 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:12.642292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca552dc-b5d5-410e-a155-7917505fd927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:12.677385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:12.722232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cca552dc-b5d5-410e-a155-7917505fd927 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:12.723702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cca552dc-b5d5-410e-a155-7917505fd927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:12.842234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 514/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:13.172960 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0546bb-e00b-4080-9027-f9887d19bfbd None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:13.173322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0546bb-e00b-4080-9027-f9887d19bfbd None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:13.173672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0546bb-e00b-4080-9027-f9887d19bfbd None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:13.175281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 534/1048] 10.222.0.16 () {54 vars in 963 bytes} [Tue Oct 11 13:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:13.180359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e795381-9350-4afa-a8a0-7c9949ea2b0d None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:13.180717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e795381-9350-4afa-a8a0-7c9949ea2b0d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:13.181047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e795381-9350-4afa-a8a0-7c9949ea2b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:13.260740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2e795381-9350-4afa-a8a0-7c9949ea2b0d None None] MFA Rules not processed for user `e466d119406f489b962596b7cd9fb7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:13.261929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2e795381-9350-4afa-a8a0-7c9949ea2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:13.311730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:13.347063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 515/1049] 10.222.0.16 () {58 vars in 1060 bytes} [Tue Oct 11 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:13.354849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0546bb-e00b-4080-9027-f9887d19bfbd None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:13.356467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9d0546bb-e00b-4080-9027-f9887d19bfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:13.412445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:13.469679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0546bb-e00b-4080-9027-f9887d19bfbd None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:13.550716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec937b5-f3ae-43b0-98d4-f52ed1390d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:13.551498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec937b5-f3ae-43b0-98d4-f52ed1390d25 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:13.551796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec937b5-f3ae-43b0-98d4-f52ed1390d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:13.552063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec937b5-f3ae-43b0-98d4-f52ed1390d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:13.554078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-dec937b5-f3ae-43b0-98d4-f52ed1390d25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:13.691405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:13.709754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec937b5-f3ae-43b0-98d4-f52ed1390d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:13.711445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec937b5-f3ae-43b0-98d4-f52ed1390d25 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:13.738733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 535/1050] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:14.821941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633e24-dcd5-4470-98f5-427b65e2e99b None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:14.822607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633e24-dcd5-4470-98f5-427b65e2e99b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:14.822607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633e24-dcd5-4470-98f5-427b65e2e99b None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:14.823897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 516/1051] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:14.829235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b52a-afb7-4f78-899a-3f713c10163a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:14.829657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b52a-afb7-4f78-899a-3f713c10163a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:14.829809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b52a-afb7-4f78-899a-3f713c10163a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:14.900180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f2f9b52a-afb7-4f78-899a-3f713c10163a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:14.901677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f2f9b52a-afb7-4f78-899a-3f713c10163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:15.030906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 536/1052] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:15.325365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43633e24-dcd5-4470-98f5-427b65e2e99b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:15.327084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-43633e24-dcd5-4470-98f5-427b65e2e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:15.490091 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43633e24-dcd5-4470-98f5-427b65e2e99b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:15.546368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:15.620516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a198cbc-7a9c-4d78-b74b-8cda79574f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:15.621364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a198cbc-7a9c-4d78-b74b-8cda79574f30 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:15.621756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a198cbc-7a9c-4d78-b74b-8cda79574f30 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:15.622126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a198cbc-7a9c-4d78-b74b-8cda79574f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:15.624564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3a198cbc-7a9c-4d78-b74b-8cda79574f30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:15.733815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a198cbc-7a9c-4d78-b74b-8cda79574f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:15.735670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a198cbc-7a9c-4d78-b74b-8cda79574f30 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:15.756080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 517/1053] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:18.190744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb926-f317-4491-af47-f51bb2ee0edf None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:18.191418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb926-f317-4491-af47-f51bb2ee0edf None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:18.191418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb926-f317-4491-af47-f51bb2ee0edf None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:18.192829 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 537/1054] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:18.198070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280a410-b79c-4514-9a04-9504551e3602 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:18.198665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280a410-b79c-4514-9a04-9504551e3602 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:18.198665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280a410-b79c-4514-9a04-9504551e3602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:18.267017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4280a410-b79c-4514-9a04-9504551e3602 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:18.268230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4280a410-b79c-4514-9a04-9504551e3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:18.275231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:18.377677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 518/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:20:18.665505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb926-f317-4491-af47-f51bb2ee0edf None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:18.667047 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2fcdb926-f317-4491-af47-f51bb2ee0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:18.733347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:18.824802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb926-f317-4491-af47-f51bb2ee0edf None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:18.962400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb627ee-9875-40a6-b150-84177ca0c8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:18.963050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb627ee-9875-40a6-b150-84177ca0c8e0 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:18.963328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb627ee-9875-40a6-b150-84177ca0c8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:18.963599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb627ee-9875-40a6-b150-84177ca0c8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:18.965231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3fb627ee-9875-40a6-b150-84177ca0c8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:18.987588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:19.078167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb627ee-9875-40a6-b150-84177ca0c8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:19.079907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb627ee-9875-40a6-b150-84177ca0c8e0 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:19.099251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 538/1056] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:21.298410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26706aba-2324-464a-92e5-ae6352db84c8 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:21.298954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26706aba-2324-464a-92e5-ae6352db84c8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:21.298954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26706aba-2324-464a-92e5-ae6352db84c8 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:21.300230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 519/1057] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:21.306395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e2e20-81b7-460b-89e2-52894d30f0b5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:21.306904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e2e20-81b7-460b-89e2-52894d30f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:21.307000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e2e20-81b7-460b-89e2-52894d30f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:21.378996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ea7e2e20-81b7-460b-89e2-52894d30f0b5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:21.380290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ea7e2e20-81b7-460b-89e2-52894d30f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:21.481801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:21.489439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 539/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:21.776267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26706aba-2324-464a-92e5-ae6352db84c8 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:21.777826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-26706aba-2324-464a-92e5-ae6352db84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:21.937252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:21.955834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26706aba-2324-464a-92e5-ae6352db84c8 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:22.095006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b4d4-72aa-4c20-8881-320b03316430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:22.095497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b4d4-72aa-4c20-8881-320b03316430 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:22.095781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b4d4-72aa-4c20-8881-320b03316430 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:22.096062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b4d4-72aa-4c20-8881-320b03316430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:22.097753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-50b8b4d4-72aa-4c20-8881-320b03316430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:22.208889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b4d4-72aa-4c20-8881-320b03316430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:22.210802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b4d4-72aa-4c20-8881-320b03316430 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:22.222796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:22.232805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 520/1059] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:24.413797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2bfa2-a6c1-4f06-8723-a7a0b5485cd2 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:24.414361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2bfa2-a6c1-4f06-8723-a7a0b5485cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:24.414361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2bfa2-a6c1-4f06-8723-a7a0b5485cd2 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:24.415702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 540/1060] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:24.423307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3b2f-ed93-4428-b939-4d2e3f061f80 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:24.423764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3b2f-ed93-4428-b939-4d2e3f061f80 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:24.423877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3b2f-ed93-4428-b939-4d2e3f061f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:24.509612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-66ff3b2f-ed93-4428-b939-4d2e3f061f80 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:24.511796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-66ff3b2f-ed93-4428-b939-4d2e3f061f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:24.658028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 521/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:25.017675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2bfa2-a6c1-4f06-8723-a7a0b5485cd2 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:25.020015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-dcf2bfa2-a6c1-4f06-8723-a7a0b5485cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:25.174973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2bfa2-a6c1-4f06-8723-a7a0b5485cd2 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:25.245631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:25.296254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5f2fd-8001-492e-b269-86c442c1db52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:25.296908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f2fd-8001-492e-b269-86c442c1db52 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:25.297196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f2fd-8001-492e-b269-86c442c1db52 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:25.297464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f2fd-8001-492e-b269-86c442c1db52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:25.299214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4be5f2fd-8001-492e-b269-86c442c1db52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:25.426701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5f2fd-8001-492e-b269-86c442c1db52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:25.429795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5f2fd-8001-492e-b269-86c442c1db52 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:25.458807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 541/1062] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:20:27.603836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b1e8-7c70-4f7d-9af4-a1f7bb9b333f None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:27.604370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b1e8-7c70-4f7d-9af4-a1f7bb9b333f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:27.604370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b1e8-7c70-4f7d-9af4-a1f7bb9b333f None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:27.605803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 522/1063] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:27.611144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184763f4-39d3-4131-a2d2-e573fddbd705 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:27.611585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184763f4-39d3-4131-a2d2-e573fddbd705 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:27.611680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184763f4-39d3-4131-a2d2-e573fddbd705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:27.680911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-184763f4-39d3-4131-a2d2-e573fddbd705 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:27.682153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-184763f4-39d3-4131-a2d2-e573fddbd705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:27.718027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:27.783624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 542/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:28.067957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b1e8-7c70-4f7d-9af4-a1f7bb9b333f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:28.069618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-da69b1e8-7c70-4f7d-9af4-a1f7bb9b333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:28.147611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:28.220237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b1e8-7c70-4f7d-9af4-a1f7bb9b333f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:28.333927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696a736-b321-44ee-ae92-cd3308da5558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:28.334459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696a736-b321-44ee-ae92-cd3308da5558 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:28.334903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696a736-b321-44ee-ae92-cd3308da5558 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:28.335056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696a736-b321-44ee-ae92-cd3308da5558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:28.337133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2696a736-b321-44ee-ae92-cd3308da5558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:28.377510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:28.429142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696a736-b321-44ee-ae92-cd3308da5558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:28.430768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696a736-b321-44ee-ae92-cd3308da5558 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:28.448944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 523/1065] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:28.934442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e31bf-2b12-4e1e-9514-5e3202377cc2 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:28.935032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e31bf-2b12-4e1e-9514-5e3202377cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:28.935032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e31bf-2b12-4e1e-9514-5e3202377cc2 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:28.936468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 543/1066] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:28.942030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a2851-80b2-44de-ad5d-beb826bd4796 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:28.942455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a2851-80b2-44de-ad5d-beb826bd4796 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:28.942570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a2851-80b2-44de-ad5d-beb826bd4796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:29.012519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1d5a2851-80b2-44de-ad5d-beb826bd4796 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:29.013761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1d5a2851-80b2-44de-ad5d-beb826bd4796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:29.111600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 524/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:29.409320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263a276-24fc-4005-8036-ddf56a4d3139 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:29.409602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263a276-24fc-4005-8036-ddf56a4d3139 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:29.409871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263a276-24fc-4005-8036-ddf56a4d3139 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:29.411413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 544/1068] 10.222.0.16 () {54 vars in 962 bytes} [Tue Oct 11 13:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:29.416948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba726c7-740b-40d7-8355-595ddf6626e4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:29.417234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba726c7-740b-40d7-8355-595ddf6626e4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:29.417506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba726c7-740b-40d7-8355-595ddf6626e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:29.434500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:29.500717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-eba726c7-740b-40d7-8355-595ddf6626e4 None None] MFA Rules not processed for user `1a06e2819ffa4bbcaaf07f8b962c531c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:29.501924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-eba726c7-740b-40d7-8355-595ddf6626e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:29.581544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 525/1069] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Oct 11 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:29.590937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263a276-24fc-4005-8036-ddf56a4d3139 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:29.592580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a263a276-24fc-4005-8036-ddf56a4d3139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:29.703730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263a276-24fc-4005-8036-ddf56a4d3139 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:29.766050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:29.782091 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3ac2f-f3ab-4898-86fe-fc456fb5a45d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:29.782690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ac2f-f3ab-4898-86fe-fc456fb5a45d service glance] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:29.783066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ac2f-f3ab-4898-86fe-fc456fb5a45d service glance] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:29.783329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ac2f-f3ab-4898-86fe-fc456fb5a45d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:29.784912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f3c3ac2f-f3ab-4898-86fe-fc456fb5a45d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:29.903924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3ac2f-f3ab-4898-86fe-fc456fb5a45d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:29.905293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3ac2f-f3ab-4898-86fe-fc456fb5a45d service glance] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:29.924814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 545/1070] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:30.646892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b09f27-3ff0-4e2c-b9b9-4ebdeb473d83 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:30.646892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b09f27-3ff0-4e2c-b9b9-4ebdeb473d83 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:30.646892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b09f27-3ff0-4e2c-b9b9-4ebdeb473d83 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:30.648085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 526/1071] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:30.655141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe04a9-c29b-4806-a5ba-bf69a4db6679 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:30.655900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe04a9-c29b-4806-a5ba-bf69a4db6679 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:30.657034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe04a9-c29b-4806-a5ba-bf69a4db6679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:30.673158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9670e-cc5e-486b-9ddb-9445ae07a3df None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:30.673520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9670e-cc5e-486b-9ddb-9445ae07a3df None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:30.673882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9670e-cc5e-486b-9ddb-9445ae07a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:30.725528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-52fe04a9-c29b-4806-a5ba-bf69a4db6679 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:30.726945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-52fe04a9-c29b-4806-a5ba-bf69a4db6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:30.742751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-03f9670e-cc5e-486b-9ddb-9445ae07a3df None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:30.744085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-03f9670e-cc5e-486b-9ddb-9445ae07a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:30.769590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:30.800214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:30.830675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 546/1072] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:30.834440 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 527/1073] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:20:30.880959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f128-7992-4049-b5a6-f0df52f446c2 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:30.881248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f128-7992-4049-b5a6-f0df52f446c2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:30.881540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f128-7992-4049-b5a6-f0df52f446c2 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:30.883316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 547/1074] 10.222.0.16 () {54 vars in 943 bytes} [Tue Oct 11 13:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:30.889800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:30.890084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:30.890353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:30.968141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] MFA Rules not processed for user `49febc522c0845be9c92b13169bdbc68`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:30.969475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:31.079241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 528/1075] 10.222.0.16 () {58 vars in 1040 bytes} [Tue Oct 11 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:31.089017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3f128-7992-4049-b5a6-f0df52f446c2 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:31.090561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-84d3f128-7992-4049-b5a6-f0df52f446c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:31.116751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:31.117991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:31.149000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:31.221043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310ff7-71e2-4d54-bcab-16a8c5c04015 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:31.236459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3f128-7992-4049-b5a6-f0df52f446c2 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:31.272925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:31.339039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b442-234a-4794-9773-0309ea55fbed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:31.339673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b442-234a-4794-9773-0309ea55fbed service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:31.339936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b442-234a-4794-9773-0309ea55fbed service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:31.340205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b442-234a-4794-9773-0309ea55fbed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:31.341802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f2c9b442-234a-4794-9773-0309ea55fbed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:31.347145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfeea3-1666-4cbd-b00d-e54a1a218e95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:31.347769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfeea3-1666-4cbd-b00d-e54a1a218e95 service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:31.348057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfeea3-1666-4cbd-b00d-e54a1a218e95 service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:31.348322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfeea3-1666-4cbd-b00d-e54a1a218e95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:31.349956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-46dfeea3-1666-4cbd-b00d-e54a1a218e95 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:31.384547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:31.434109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b442-234a-4794-9773-0309ea55fbed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:31.435740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b442-234a-4794-9773-0309ea55fbed service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:31.435893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfeea3-1666-4cbd-b00d-e54a1a218e95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:31.437663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfeea3-1666-4cbd-b00d-e54a1a218e95 service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:31.445914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 548/1076] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:20:31.455094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 529/1077] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:33.658171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9323-4cd9-4ff8-9f64-62e6372f4cad None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:33.658735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9323-4cd9-4ff8-9f64-62e6372f4cad None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:33.658735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9323-4cd9-4ff8-9f64-62e6372f4cad None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:33.659993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 549/1078] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:33.665232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edf15-00ac-43bf-ba53-b2fc573fa66e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:33.665683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edf15-00ac-43bf-ba53-b2fc573fa66e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:33.665788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edf15-00ac-43bf-ba53-b2fc573fa66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:33.739081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5c1edf15-00ac-43bf-ba53-b2fc573fa66e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:33.740309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5c1edf15-00ac-43bf-ba53-b2fc573fa66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:33.851247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 530/1079] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:34.136366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9323-4cd9-4ff8-9f64-62e6372f4cad None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:34.137955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9fbf9323-4cd9-4ff8-9f64-62e6372f4cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:34.215907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:34.294419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9323-4cd9-4ff8-9f64-62e6372f4cad None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:34.429527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fded6-a2e1-44f6-a99d-a0ac130e8d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:34.430056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fded6-a2e1-44f6-a99d-a0ac130e8d2a service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:34.430332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fded6-a2e1-44f6-a99d-a0ac130e8d2a service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:34.430594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fded6-a2e1-44f6-a99d-a0ac130e8d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:34.432224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9a4fded6-a2e1-44f6-a99d-a0ac130e8d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:34.466760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:34.545078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fded6-a2e1-44f6-a99d-a0ac130e8d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:34.546956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fded6-a2e1-44f6-a99d-a0ac130e8d2a service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:34.575000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 550/1080] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:36.785141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97060090-5e85-4d19-ac04-1253ad37663e None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:36.785717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97060090-5e85-4d19-ac04-1253ad37663e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:36.785911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97060090-5e85-4d19-ac04-1253ad37663e None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:36.787374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 531/1081] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:36.792903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a38af-dbd4-4232-bc55-b3650729f973 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:36.793332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a38af-dbd4-4232-bc55-b3650729f973 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:36.793442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a38af-dbd4-4232-bc55-b3650729f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:36.876445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1c0a38af-dbd4-4232-bc55-b3650729f973 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:36.876923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1c0a38af-dbd4-4232-bc55-b3650729f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:36.983574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 551/1082] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:37.327915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97060090-5e85-4d19-ac04-1253ad37663e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:37.329741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-97060090-5e85-4d19-ac04-1253ad37663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:37.355003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:37.514983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97060090-5e85-4d19-ac04-1253ad37663e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:37.615620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:37.642507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0aa0-2a00-499b-aa44-aa6cc3a4a61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:37.643145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0aa0-2a00-499b-aa44-aa6cc3a4a61f service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:37.643418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0aa0-2a00-499b-aa44-aa6cc3a4a61f service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:37.643683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0aa0-2a00-499b-aa44-aa6cc3a4a61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:37.645276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4a1a0aa0-2a00-499b-aa44-aa6cc3a4a61f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:37.744357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0aa0-2a00-499b-aa44-aa6cc3a4a61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:37.746158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0aa0-2a00-499b-aa44-aa6cc3a4a61f service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:37.764419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 532/1083] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:39.972562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499421-717a-4e2d-9d5e-0db4e95ae5ab None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:39.973580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499421-717a-4e2d-9d5e-0db4e95ae5ab None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:39.974160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499421-717a-4e2d-9d5e-0db4e95ae5ab None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:39.975957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 552/1084] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:39.981340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be4b5c-16dc-4703-ba45-e5fb0729c5e4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:39.982099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be4b5c-16dc-4703-ba45-e5fb0729c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:39.982374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be4b5c-16dc-4703-ba45-e5fb0729c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:40.059338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-02be4b5c-16dc-4703-ba45-e5fb0729c5e4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:40.060613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-02be4b5c-16dc-4703-ba45-e5fb0729c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:40.116529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:40.161820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 533/1085] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:40.455253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499421-717a-4e2d-9d5e-0db4e95ae5ab None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:40.455253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7b499421-717a-4e2d-9d5e-0db4e95ae5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:40.463579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:40.626911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499421-717a-4e2d-9d5e-0db4e95ae5ab None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:40.715078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:40.753101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a60582-00b7-4b62-89fe-6ac1ac95e76f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:40.754014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60582-00b7-4b62-89fe-6ac1ac95e76f service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:40.754454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60582-00b7-4b62-89fe-6ac1ac95e76f service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:40.754938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60582-00b7-4b62-89fe-6ac1ac95e76f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:40.756911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-76a60582-00b7-4b62-89fe-6ac1ac95e76f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:40.858413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a60582-00b7-4b62-89fe-6ac1ac95e76f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:40.860366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a60582-00b7-4b62-89fe-6ac1ac95e76f service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:40.880236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 553/1086] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:50.162294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=19 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:50.877682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=59 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:53.688193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3663d-716f-4a59-9eac-67a0545a8183 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:53.688741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3663d-716f-4a59-9eac-67a0545a8183 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:53.688741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3663d-716f-4a59-9eac-67a0545a8183 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:53.690009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 534/1087] 10.222.0.16 () {54 vars in 918 bytes} [Tue Oct 11 13:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:53.695200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d693a-d7a8-40ca-850b-81ee10d4975c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:53.695617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d693a-d7a8-40ca-850b-81ee10d4975c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:53.695729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d693a-d7a8-40ca-850b-81ee10d4975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:53.781635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5c3d693a-d7a8-40ca-850b-81ee10d4975c None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:53.782850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5c3d693a-d7a8-40ca-850b-81ee10d4975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:53.892270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 554/1088] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Oct 11 13:20:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:53.909989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207370-fcc7-4411-a9d1-45210d76f29a None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:53.910287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207370-fcc7-4411-a9d1-45210d76f29a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:53.910669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207370-fcc7-4411-a9d1-45210d76f29a None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:53.912711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 535/1089] 10.222.0.16 () {54 vars in 918 bytes} [Tue Oct 11 13:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:53.917494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed265ba9-d775-4dc5-9ac8-318e2b6d8b37 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:53.917779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed265ba9-d775-4dc5-9ac8-318e2b6d8b37 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:53.918049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed265ba9-d775-4dc5-9ac8-318e2b6d8b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:53.991426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:53.993954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ed265ba9-d775-4dc5-9ac8-318e2b6d8b37 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:53.995180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ed265ba9-d775-4dc5-9ac8-318e2b6d8b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:54.115034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 555/1090] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Oct 11 13:20:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:56.680055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c17d-7011-4507-bf2e-ce6bbe5ef143 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:56.680930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c17d-7011-4507-bf2e-ce6bbe5ef143 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:56.680930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c17d-7011-4507-bf2e-ce6bbe5ef143 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:56.683125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 536/1091] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:20:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:56.688606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5616-ee52-4895-83b0-7782345e5011 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:56.689039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5616-ee52-4895-83b0-7782345e5011 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:56.689139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5616-ee52-4895-83b0-7782345e5011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:56.758351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e81f5616-ee52-4895-83b0-7782345e5011 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:56.759584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e81f5616-ee52-4895-83b0-7782345e5011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:56.819810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:56.862274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 556/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:57.148149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c17d-7011-4507-bf2e-ce6bbe5ef143 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:57.149730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9ed9c17d-7011-4507-bf2e-ce6bbe5ef143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:57.310170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c17d-7011-4507-bf2e-ce6bbe5ef143 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:57.390210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:57.434347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f73e83-e986-4210-9e84-92985720f2bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:57.435054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73e83-e986-4210-9e84-92985720f2bc service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:57.435327 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73e83-e986-4210-9e84-92985720f2bc service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:57.435590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73e83-e986-4210-9e84-92985720f2bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:57.437286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b6f73e83-e986-4210-9e84-92985720f2bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:57.540480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f73e83-e986-4210-9e84-92985720f2bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:57.542059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f73e83-e986-4210-9e84-92985720f2bc service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:57.561644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 537/1093] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:58.701731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c3db-eabc-44d7-9877-0305945a753a None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:58.702298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c3db-eabc-44d7-9877-0305945a753a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:58.702298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c3db-eabc-44d7-9877-0305945a753a None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:58.703664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 557/1094] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:20:58.711236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060354-176e-4376-bb20-e4a95dc42ec1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:58.711673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060354-176e-4376-bb20-e4a95dc42ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:58.711782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060354-176e-4376-bb20-e4a95dc42ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:58.799137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1b060354-176e-4376-bb20-e4a95dc42ec1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:20:58.803272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1b060354-176e-4376-bb20-e4a95dc42ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:58.839052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:58.929225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 538/1095] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:20:59.118259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870c3db-eabc-44d7-9877-0305945a753a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:20:59.119825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7870c3db-eabc-44d7-9877-0305945a753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:59.316700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870c3db-eabc-44d7-9877-0305945a753a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:20:59.367148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:59.464956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa567d-7663-4342-abe4-300196e51462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:20:59.465533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa567d-7663-4342-abe4-300196e51462 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:20:59.465808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa567d-7663-4342-abe4-300196e51462 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:20:59.466102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa567d-7663-4342-abe4-300196e51462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:20:59.467723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-25aa567d-7663-4342-abe4-300196e51462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:20:59.566559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa567d-7663-4342-abe4-300196e51462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:20:59.568265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa567d-7663-4342-abe4-300196e51462 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:20:59.586672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 558/1096] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:00.719379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffddd2e-d6e1-4c07-947c-0e9efe4a5948 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:00.720230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffddd2e-d6e1-4c07-947c-0e9efe4a5948 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:00.720230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffddd2e-d6e1-4c07-947c-0e9efe4a5948 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:00.722361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 539/1097] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:00.729893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dce93-4d64-4d96-b14e-c8be011b9b42 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:00.730627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dce93-4d64-4d96-b14e-c8be011b9b42 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:00.730775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dce93-4d64-4d96-b14e-c8be011b9b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:00.792148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:00.818647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2d0dce93-4d64-4d96-b14e-c8be011b9b42 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:00.819905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2d0dce93-4d64-4d96-b14e-c8be011b9b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:00.919241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 559/1098] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:01.073558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffddd2e-d6e1-4c07-947c-0e9efe4a5948 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:01.075139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0ffddd2e-d6e1-4c07-947c-0e9efe4a5948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:01.230375 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffddd2e-d6e1-4c07-947c-0e9efe4a5948 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:01.243509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:01.353851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f623-dd81-4176-8842-ab6c5425ff2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:01.354466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f623-dd81-4176-8842-ab6c5425ff2f service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:01.354738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f623-dd81-4176-8842-ab6c5425ff2f service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:01.355034 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f623-dd81-4176-8842-ab6c5425ff2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:01.356658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7aa1f623-dd81-4176-8842-ab6c5425ff2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:01.462153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f623-dd81-4176-8842-ab6c5425ff2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:01.463805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f623-dd81-4176-8842-ab6c5425ff2f service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:01.482075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 540/1099] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:02.578635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f8fe-ef03-4e8e-88c7-db98a69dea84 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:02.579182 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f8fe-ef03-4e8e-88c7-db98a69dea84 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:02.579182 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f8fe-ef03-4e8e-88c7-db98a69dea84 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:02.580615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 560/1100] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:02.587601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265a16c-7940-439f-b603-36e5f6234fb8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:02.588061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265a16c-7940-439f-b603-36e5f6234fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:02.588154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265a16c-7940-439f-b603-36e5f6234fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:02.608590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:02.675458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1265a16c-7940-439f-b603-36e5f6234fb8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:02.676702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1265a16c-7940-439f-b603-36e5f6234fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:02.785396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 541/1101] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:21:02.949796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f8fe-ef03-4e8e-88c7-db98a69dea84 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:02.952265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9e24f8fe-ef03-4e8e-88c7-db98a69dea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:03.072395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:03.109060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f8fe-ef03-4e8e-88c7-db98a69dea84 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:03.227454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a74b5-ad41-444c-a001-eb2918c4721c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:03.227980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a74b5-ad41-444c-a001-eb2918c4721c service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:03.228251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a74b5-ad41-444c-a001-eb2918c4721c service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:03.228511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a74b5-ad41-444c-a001-eb2918c4721c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:03.230119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-af6a74b5-ad41-444c-a001-eb2918c4721c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:03.313090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:03.330738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a74b5-ad41-444c-a001-eb2918c4721c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:03.332414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a74b5-ad41-444c-a001-eb2918c4721c service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:03.351791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 561/1102] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:04.472148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d818-e00e-43b8-853e-a0e64a8729b1 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:04.472773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d818-e00e-43b8-853e-a0e64a8729b1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:04.472773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d818-e00e-43b8-853e-a0e64a8729b1 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:04.474086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 542/1103] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:04.481816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c0f2-35a7-4f8a-979a-5f7ab4b27993 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:04.482549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c0f2-35a7-4f8a-979a-5f7ab4b27993 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:04.482766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c0f2-35a7-4f8a-979a-5f7ab4b27993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:04.566941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7ff0c0f2-35a7-4f8a-979a-5f7ab4b27993 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:04.568162 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7ff0c0f2-35a7-4f8a-979a-5f7ab4b27993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:04.666491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 562/1104] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:04.815851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d818-e00e-43b8-853e-a0e64a8729b1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:04.818144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e645d818-e00e-43b8-853e-a0e64a8729b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:04.908813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:04.976085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d818-e00e-43b8-853e-a0e64a8729b1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:05.103694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490b0b1-8252-438f-83db-d04c24a1b41f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:05.104312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b0b1-8252-438f-83db-d04c24a1b41f service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:05.104589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b0b1-8252-438f-83db-d04c24a1b41f service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:05.104862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b0b1-8252-438f-83db-d04c24a1b41f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:05.106470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5490b0b1-8252-438f-83db-d04c24a1b41f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:05.155775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:05.198116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490b0b1-8252-438f-83db-d04c24a1b41f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:05.199746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490b0b1-8252-438f-83db-d04c24a1b41f service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:05.217973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 543/1105] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:06.269791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82d47-787d-4467-8671-041e1407e8bb None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:06.270685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82d47-787d-4467-8671-041e1407e8bb None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:06.270685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82d47-787d-4467-8671-041e1407e8bb None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:06.273054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 563/1106] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:21:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:06.279622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b4cd5-ccc6-480f-853f-409dddbb12c1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:06.280061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b4cd5-ccc6-480f-853f-409dddbb12c1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:06.280186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b4cd5-ccc6-480f-853f-409dddbb12c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:06.360517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-307b4cd5-ccc6-480f-853f-409dddbb12c1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:06.361731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-307b4cd5-ccc6-480f-853f-409dddbb12c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:06.465090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 544/1107] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:06.619353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82d47-787d-4467-8671-041e1407e8bb None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:06.621577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-59b82d47-787d-4467-8671-041e1407e8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:06.681437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:06.782696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82d47-787d-4467-8671-041e1407e8bb None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:06.913152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6f38-e247-4725-a145-2d85c79847bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:06.913698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6f38-e247-4725-a145-2d85c79847bb service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:06.913972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6f38-e247-4725-a145-2d85c79847bb service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:06.914233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6f38-e247-4725-a145-2d85c79847bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:06.915883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e33a6f38-e247-4725-a145-2d85c79847bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:06.926320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:07.017267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6f38-e247-4725-a145-2d85c79847bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:07.018882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6f38-e247-4725-a145-2d85c79847bb service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:07.038250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 564/1108] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:08.101017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937706-b047-48b7-bd7e-d10ae270f9ed None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:08.101911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937706-b047-48b7-bd7e-d10ae270f9ed None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:08.101911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937706-b047-48b7-bd7e-d10ae270f9ed None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:08.104077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 545/1109] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:21:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:08.114226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e348411-5450-43d6-bac8-09cde93dff3a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:08.114699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e348411-5450-43d6-bac8-09cde93dff3a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:08.114805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e348411-5450-43d6-bac8-09cde93dff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:08.197203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1e348411-5450-43d6-bac8-09cde93dff3a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:08.198981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1e348411-5450-43d6-bac8-09cde93dff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:08.276201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:08.316584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 565/1110] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:08.468207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937706-b047-48b7-bd7e-d10ae270f9ed None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:08.470580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-19937706-b047-48b7-bd7e-d10ae270f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:08.490306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:08.627453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937706-b047-48b7-bd7e-d10ae270f9ed None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:08.720684 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:08.747214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00594-ac86-4d4c-940c-0fe89787a33a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:08.747819 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00594-ac86-4d4c-940c-0fe89787a33a service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:08.748092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00594-ac86-4d4c-940c-0fe89787a33a service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:08.748362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00594-ac86-4d4c-940c-0fe89787a33a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:08.749955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-88c00594-ac86-4d4c-940c-0fe89787a33a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:08.853934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00594-ac86-4d4c-940c-0fe89787a33a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:08.855580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00594-ac86-4d4c-940c-0fe89787a33a service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:08.875127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 546/1111] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:09.938289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6236-3f60-41cb-a59b-bf9a97ae7601 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:09.938923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6236-3f60-41cb-a59b-bf9a97ae7601 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:09.938923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6236-3f60-41cb-a59b-bf9a97ae7601 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:09.940869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 566/1112] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:21:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:09.952053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cf23f-e276-44be-a08b-e9cc1ffb8966 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:09.952515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cf23f-e276-44be-a08b-e9cc1ffb8966 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:09.952622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cf23f-e276-44be-a08b-e9cc1ffb8966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:10.041574 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d74cf23f-e276-44be-a08b-e9cc1ffb8966 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:10.042698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d74cf23f-e276-44be-a08b-e9cc1ffb8966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:10.085331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:10.143232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 547/1113] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:10.295125 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a6236-3f60-41cb-a59b-bf9a97ae7601 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:10.296886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0f3a6236-3f60-41cb-a59b-bf9a97ae7601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:10.458185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a6236-3f60-41cb-a59b-bf9a97ae7601 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:10.526812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:10.591928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23203056-b09b-4a42-a1e0-57ca59797b14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:10.592459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23203056-b09b-4a42-a1e0-57ca59797b14 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:10.592736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23203056-b09b-4a42-a1e0-57ca59797b14 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:10.593012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23203056-b09b-4a42-a1e0-57ca59797b14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:10.594663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-23203056-b09b-4a42-a1e0-57ca59797b14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:10.701132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23203056-b09b-4a42-a1e0-57ca59797b14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:10.702771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23203056-b09b-4a42-a1e0-57ca59797b14 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:10.721313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 567/1114] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:11.785195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450b7a-aae3-4113-8498-d31ba76d504a None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:11.786077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450b7a-aae3-4113-8498-d31ba76d504a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:11.786077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450b7a-aae3-4113-8498-d31ba76d504a None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:11.788267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 548/1115] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:21:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:11.794851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2e4c-8169-4e28-816b-2d80282451a3 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:11.795619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2e4c-8169-4e28-816b-2d80282451a3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:11.795727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2e4c-8169-4e28-816b-2d80282451a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:11.875326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f1ff2e4c-8169-4e28-816b-2d80282451a3 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:11.876538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f1ff2e4c-8169-4e28-816b-2d80282451a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:11.878615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:11.980586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 568/1116] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:12.132868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450b7a-aae3-4113-8498-d31ba76d504a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:12.134297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6d450b7a-aae3-4113-8498-d31ba76d504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:12.298067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450b7a-aae3-4113-8498-d31ba76d504a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:12.329104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:12.428671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb5c28-2ed6-44a2-8926-b92aeeb32714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:12.429201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5c28-2ed6-44a2-8926-b92aeeb32714 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:12.429462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5c28-2ed6-44a2-8926-b92aeeb32714 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:12.429724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5c28-2ed6-44a2-8926-b92aeeb32714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:12.431400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5dfb5c28-2ed6-44a2-8926-b92aeeb32714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:12.527525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb5c28-2ed6-44a2-8926-b92aeeb32714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:12.529122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb5c28-2ed6-44a2-8926-b92aeeb32714 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:12.548402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 549/1117] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:14.572579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e750b7-45f4-4320-92fd-1a6f8c965308 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:14.573133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e750b7-45f4-4320-92fd-1a6f8c965308 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:14.573133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e750b7-45f4-4320-92fd-1a6f8c965308 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:14.574553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 569/1118] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:14.580143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d338f-bc22-47eb-96c6-23cb33e143b1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:14.580563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d338f-bc22-47eb-96c6-23cb33e143b1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:14.580689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d338f-bc22-47eb-96c6-23cb33e143b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:14.622236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:14.648556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-502d338f-bc22-47eb-96c6-23cb33e143b1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:14.649767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-502d338f-bc22-47eb-96c6-23cb33e143b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:14.755281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 550/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:15.050124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e750b7-45f4-4320-92fd-1a6f8c965308 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:15.051771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-38e750b7-45f4-4320-92fd-1a6f8c965308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:15.168320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e750b7-45f4-4320-92fd-1a6f8c965308 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:15.201620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:15.246610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511f95-36e1-4110-9c9c-45ff90f77edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:15.247261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511f95-36e1-4110-9c9c-45ff90f77edc service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:15.247540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511f95-36e1-4110-9c9c-45ff90f77edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:15.247814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511f95-36e1-4110-9c9c-45ff90f77edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:15.249420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a511f95-36e1-4110-9c9c-45ff90f77edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:15.367680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511f95-36e1-4110-9c9c-45ff90f77edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:15.369151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511f95-36e1-4110-9c9c-45ff90f77edc service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:15.388452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 570/1120] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:21:17.652484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a78bd-7bd5-4805-be1e-e91d6b9ee02a None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:17.653310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a78bd-7bd5-4805-be1e-e91d6b9ee02a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:17.653310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a78bd-7bd5-4805-be1e-e91d6b9ee02a None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:17.655398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 551/1121] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:17.664366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8bc32-a921-4c8e-bced-8fa7ff166f6b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:17.664777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8bc32-a921-4c8e-bced-8fa7ff166f6b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:17.664944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8bc32-a921-4c8e-bced-8fa7ff166f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:17.752684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-35d8bc32-a921-4c8e-bced-8fa7ff166f6b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:17.753898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-35d8bc32-a921-4c8e-bced-8fa7ff166f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:17.767523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:17.855621 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 571/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:18.139249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a78bd-7bd5-4805-be1e-e91d6b9ee02a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:18.141594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9a4a78bd-7bd5-4805-be1e-e91d6b9ee02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:18.249626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a78bd-7bd5-4805-be1e-e91d6b9ee02a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:18.264204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:18.332389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d791247-258e-4772-ac54-d6c56aae6bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:18.332984 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d791247-258e-4772-ac54-d6c56aae6bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:18.333292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d791247-258e-4772-ac54-d6c56aae6bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:18.333562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d791247-258e-4772-ac54-d6c56aae6bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:18.335276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4d791247-258e-4772-ac54-d6c56aae6bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:18.463983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d791247-258e-4772-ac54-d6c56aae6bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:18.465402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d791247-258e-4772-ac54-d6c56aae6bc3 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:18.484522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 552/1123] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:20.961674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260f1f-8751-4dea-be7e-5ad394225717 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:20.962283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260f1f-8751-4dea-be7e-5ad394225717 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:20.962283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260f1f-8751-4dea-be7e-5ad394225717 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:20.963570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 572/1124] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:20.970234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1016b62-d236-4d4e-8c50-1eda1b37d1bf None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:20.970952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1016b62-d236-4d4e-8c50-1eda1b37d1bf None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:20.971218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1016b62-d236-4d4e-8c50-1eda1b37d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:21.028373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:21.047399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d1016b62-d236-4d4e-8c50-1eda1b37d1bf None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:21.048611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d1016b62-d236-4d4e-8c50-1eda1b37d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:21.149979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 553/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:21.446480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260f1f-8751-4dea-be7e-5ad394225717 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:21.448083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3c260f1f-8751-4dea-be7e-5ad394225717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:21.561135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260f1f-8751-4dea-be7e-5ad394225717 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:21.603198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:21.638907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f2697-2e31-4cf6-a862-e119ffc29c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:21.639518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2697-2e31-4cf6-a862-e119ffc29c0e service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:21.639796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2697-2e31-4cf6-a862-e119ffc29c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:21.640066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2697-2e31-4cf6-a862-e119ffc29c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:21.641666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-722f2697-2e31-4cf6-a862-e119ffc29c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:21.758570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f2697-2e31-4cf6-a862-e119ffc29c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:21.760061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f2697-2e31-4cf6-a862-e119ffc29c0e service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:21.779039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 573/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:24.037384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94e56-7409-43c6-a333-979ac2bf62f1 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:24.037966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94e56-7409-43c6-a333-979ac2bf62f1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:24.037966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94e56-7409-43c6-a333-979ac2bf62f1 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:24.039312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 554/1127] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:24.046185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329538-914b-4f62-8681-0798c457feec None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:24.046908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329538-914b-4f62-8681-0798c457feec None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:24.047050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329538-914b-4f62-8681-0798c457feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:24.123330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-71329538-914b-4f62-8681-0798c457feec None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:24.124560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-71329538-914b-4f62-8681-0798c457feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:24.147064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:24.225530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 574/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:24.506199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94e56-7409-43c6-a333-979ac2bf62f1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:24.507789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-23a94e56-7409-43c6-a333-979ac2bf62f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:24.620177 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94e56-7409-43c6-a333-979ac2bf62f1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:24.640055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:24.695833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d920a-6f25-4968-9717-98428dffe862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:24.696676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d920a-6f25-4968-9717-98428dffe862 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:24.697040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d920a-6f25-4968-9717-98428dffe862 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:24.697365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d920a-6f25-4968-9717-98428dffe862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:24.699950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e72d920a-6f25-4968-9717-98428dffe862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:24.826457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d920a-6f25-4968-9717-98428dffe862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:24.827928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d920a-6f25-4968-9717-98428dffe862 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:24.846798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 555/1129] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:27.025967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439869-45c9-41f2-8104-fd118755b1b9 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:27.026920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439869-45c9-41f2-8104-fd118755b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:27.026920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439869-45c9-41f2-8104-fd118755b1b9 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:27.029001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 575/1130] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:27.034561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694c24a-60e8-4fee-a745-4ce52ef95574 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:27.035017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694c24a-60e8-4fee-a745-4ce52ef95574 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:27.035129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694c24a-60e8-4fee-a745-4ce52ef95574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:27.100752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:27.103796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9694c24a-60e8-4fee-a745-4ce52ef95574 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:27.105766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9694c24a-60e8-4fee-a745-4ce52ef95574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:27.217970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 556/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:27.502534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439869-45c9-41f2-8104-fd118755b1b9 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:27.505122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ec439869-45c9-41f2-8104-fd118755b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:27.614146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439869-45c9-41f2-8104-fd118755b1b9 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:27.666348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:27.692789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373128a9-13e0-4e11-bb65-bfac9085abf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:27.693408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373128a9-13e0-4e11-bb65-bfac9085abf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:27.693798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373128a9-13e0-4e11-bb65-bfac9085abf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:27.694069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373128a9-13e0-4e11-bb65-bfac9085abf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:27.695720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-373128a9-13e0-4e11-bb65-bfac9085abf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:27.810064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373128a9-13e0-4e11-bb65-bfac9085abf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:27.811558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373128a9-13e0-4e11-bb65-bfac9085abf9 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:27.829935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 576/1132] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:30.042589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102627fe-bddb-4983-9a44-aae5cf4231e7 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:30.043185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102627fe-bddb-4983-9a44-aae5cf4231e7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:30.043185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102627fe-bddb-4983-9a44-aae5cf4231e7 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:30.044520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 557/1133] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:30.051475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6763e-56f7-4f9d-a808-0006ecc1c60b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:30.052164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6763e-56f7-4f9d-a808-0006ecc1c60b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:30.052389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6763e-56f7-4f9d-a808-0006ecc1c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:30.121886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-11f6763e-56f7-4f9d-a808-0006ecc1c60b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:30.123112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-11f6763e-56f7-4f9d-a808-0006ecc1c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:30.154155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:30.223209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 577/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:30.509030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102627fe-bddb-4983-9a44-aae5cf4231e7 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:30.510591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-102627fe-bddb-4983-9a44-aae5cf4231e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:30.622948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102627fe-bddb-4983-9a44-aae5cf4231e7 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:30.652104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:30.698732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad2ad-9fee-4235-aadc-ac5e3ed6b954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:30.699368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad2ad-9fee-4235-aadc-ac5e3ed6b954 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:30.699637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad2ad-9fee-4235-aadc-ac5e3ed6b954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:30.699900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad2ad-9fee-4235-aadc-ac5e3ed6b954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:30.701487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-166ad2ad-9fee-4235-aadc-ac5e3ed6b954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:30.827545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad2ad-9fee-4235-aadc-ac5e3ed6b954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:30.829004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad2ad-9fee-4235-aadc-ac5e3ed6b954 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:30.847383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 558/1135] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:21:33.016151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516a15-866e-4cf1-aae4-10c9e11f050d None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:33.016999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516a15-866e-4cf1-aae4-10c9e11f050d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:33.016999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516a15-866e-4cf1-aae4-10c9e11f050d None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:33.019128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 578/1136] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:33.027287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c006c-2a0b-4161-88b3-31c5a7340ca0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:33.027762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c006c-2a0b-4161-88b3-31c5a7340ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:33.027882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c006c-2a0b-4161-88b3-31c5a7340ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:33.099172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-436c006c-2a0b-4161-88b3-31c5a7340ca0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:33.100390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-436c006c-2a0b-4161-88b3-31c5a7340ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:33.109137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:33.201540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 559/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:33.487211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe516a15-866e-4cf1-aae4-10c9e11f050d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:33.488788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fe516a15-866e-4cf1-aae4-10c9e11f050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:33.596451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe516a15-866e-4cf1-aae4-10c9e11f050d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:33.653829 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:33.680061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083cf43-4bf9-4ae3-8745-1b5a70024a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:33.680678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083cf43-4bf9-4ae3-8745-1b5a70024a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:33.680952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083cf43-4bf9-4ae3-8745-1b5a70024a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:33.681220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083cf43-4bf9-4ae3-8745-1b5a70024a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:33.682845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9083cf43-4bf9-4ae3-8745-1b5a70024a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:33.795567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083cf43-4bf9-4ae3-8745-1b5a70024a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:33.797013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083cf43-4bf9-4ae3-8745-1b5a70024a8b service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:33.815442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 579/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:36.091112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77d8e-897f-4583-96c0-a2ad0eda759e None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:36.091983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77d8e-897f-4583-96c0-a2ad0eda759e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:36.091983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77d8e-897f-4583-96c0-a2ad0eda759e None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:36.094120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 560/1139] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:36.100633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed001-8ea1-4ad1-a6a5-e4688f89a249 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:36.101072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed001-8ea1-4ad1-a6a5-e4688f89a249 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:36.101199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed001-8ea1-4ad1-a6a5-e4688f89a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:36.175183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-61bed001-8ea1-4ad1-a6a5-e4688f89a249 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:36.176388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-61bed001-8ea1-4ad1-a6a5-e4688f89a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:36.218068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:36.278429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 580/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:36.571799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77d8e-897f-4583-96c0-a2ad0eda759e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:36.573393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cdf77d8e-897f-4583-96c0-a2ad0eda759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:36.688516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77d8e-897f-4583-96c0-a2ad0eda759e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:36.728816 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:36.765425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d7bee-498c-49ed-aa9e-86a85adac76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:36.766029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7bee-498c-49ed-aa9e-86a85adac76c service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:36.766305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7bee-498c-49ed-aa9e-86a85adac76c service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:36.766562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7bee-498c-49ed-aa9e-86a85adac76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:36.768202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-634d7bee-498c-49ed-aa9e-86a85adac76c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:36.880610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d7bee-498c-49ed-aa9e-86a85adac76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:36.882044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d7bee-498c-49ed-aa9e-86a85adac76c service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:36.902445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 561/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:39.028877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54b8f7-79e9-4577-bfe5-cc10bd598865 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:39.029817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54b8f7-79e9-4577-bfe5-cc10bd598865 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:39.029817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54b8f7-79e9-4577-bfe5-cc10bd598865 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:39.032012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 581/1142] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:39.038637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1adc6-cb45-43b6-ae33-4acc524bb2d9 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:39.039127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1adc6-cb45-43b6-ae33-4acc524bb2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:39.039233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1adc6-cb45-43b6-ae33-4acc524bb2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:39.112491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-86c1adc6-cb45-43b6-ae33-4acc524bb2d9 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:39.113704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-86c1adc6-cb45-43b6-ae33-4acc524bb2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:39.134341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:39.217542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 562/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:39.499948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54b8f7-79e9-4577-bfe5-cc10bd598865 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:39.502479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3a54b8f7-79e9-4577-bfe5-cc10bd598865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:39.619132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54b8f7-79e9-4577-bfe5-cc10bd598865 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:39.698209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:39.707953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb036ef-c77a-4a38-8a2f-877a3f0091e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:39.708801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb036ef-c77a-4a38-8a2f-877a3f0091e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:39.709082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb036ef-c77a-4a38-8a2f-877a3f0091e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:39.709351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb036ef-c77a-4a38-8a2f-877a3f0091e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:39.711108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1bb036ef-c77a-4a38-8a2f-877a3f0091e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:39.824378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb036ef-c77a-4a38-8a2f-877a3f0091e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:39.825814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb036ef-c77a-4a38-8a2f-877a3f0091e7 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:39.844156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 582/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:41.965585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29d667-5a32-478b-a844-d76185886604 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:41.966174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29d667-5a32-478b-a844-d76185886604 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:41.966174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29d667-5a32-478b-a844-d76185886604 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:41.967515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 563/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:21:41.974104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812f865-95a1-4a6e-939b-4d1ddd4fa46c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:41.974876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812f865-95a1-4a6e-939b-4d1ddd4fa46c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:41.975110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812f865-95a1-4a6e-939b-4d1ddd4fa46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:42.047669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f812f865-95a1-4a6e-939b-4d1ddd4fa46c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:21:42.048857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f812f865-95a1-4a6e-939b-4d1ddd4fa46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:42.101467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:42.156482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 583/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:21:42.445647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29d667-5a32-478b-a844-d76185886604 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:21:42.448074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ad29d667-5a32-478b-a844-d76185886604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:42.563273 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29d667-5a32-478b-a844-d76185886604 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:21:42.620746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:42.647691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7319f-d78c-4c68-bfda-54254c4c6eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:21:42.648296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7319f-d78c-4c68-bfda-54254c4c6eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:21:42.648597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7319f-d78c-4c68-bfda-54254c4c6eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:21:42.648859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7319f-d78c-4c68-bfda-54254c4c6eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:21:42.650449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7ac7319f-d78c-4c68-bfda-54254c4c6eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:21:42.762336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7319f-d78c-4c68-bfda-54254c4c6eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:21:42.763791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7319f-d78c-4c68-bfda-54254c4c6eaf service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:21:42.783741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 564/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:21:52.153384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=22 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:21:52.781277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=66 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:02.631494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3db0-344d-462a-a916-acee0c5e98df None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:02.632054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3db0-344d-462a-a916-acee0c5e98df None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:02.632054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3db0-344d-462a-a916-acee0c5e98df None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:02.633290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 584/1148] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:22:02.639769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b4244-dd7e-4709-bf61-1d15efd93941 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:02.640529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b4244-dd7e-4709-bf61-1d15efd93941 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:02.640704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b4244-dd7e-4709-bf61-1d15efd93941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:02.726991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4d4b4244-dd7e-4709-bf61-1d15efd93941 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:02.728203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4d4b4244-dd7e-4709-bf61-1d15efd93941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:02.826881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 565/1149] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:22:03.127757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e268-5fe4-4cfb-9d54-2965955c69a0 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:03.128041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e268-5fe4-4cfb-9d54-2965955c69a0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:03.128310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e268-5fe4-4cfb-9d54-2965955c69a0 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:03.129700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 585/1150] 10.222.0.16 () {54 vars in 962 bytes} [Tue Oct 11 13:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:22:03.134896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838d42-f7fb-4a49-93d7-ddbaa043d994 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:03.135183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838d42-f7fb-4a49-93d7-ddbaa043d994 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:03.135478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838d42-f7fb-4a49-93d7-ddbaa043d994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:03.215115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-12838d42-f7fb-4a49-93d7-ddbaa043d994 None None] MFA Rules not processed for user `1a06e2819ffa4bbcaaf07f8b962c531c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:03.216319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-12838d42-f7fb-4a49-93d7-ddbaa043d994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:03.243639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:03.305508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 566/1151] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Oct 11 13:22:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:22:03.313378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e268-5fe4-4cfb-9d54-2965955c69a0 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:22:03.314922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8459e268-5fe4-4cfb-9d54-2965955c69a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:03.424274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e268-5fe4-4cfb-9d54-2965955c69a0 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:22:03.511193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8196-f7cb-40f5-a323-2096411783c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:22:03.511785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8196-f7cb-40f5-a323-2096411783c5 service glance] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:03.512064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8196-f7cb-40f5-a323-2096411783c5 service glance] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:03.512353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8196-f7cb-40f5-a323-2096411783c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:03.513941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5d9e8196-f7cb-40f5-a323-2096411783c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:03.576378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:03.636365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8196-f7cb-40f5-a323-2096411783c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:22:03.637729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8196-f7cb-40f5-a323-2096411783c5 service glance] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:22:03.657110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 586/1152] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:22:05.877193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326a0f-0160-41e8-97e5-9fed9e9d0826 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:05.877754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326a0f-0160-41e8-97e5-9fed9e9d0826 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:05.877754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326a0f-0160-41e8-97e5-9fed9e9d0826 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:05.879193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 567/1153] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:22:05.884654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23458a2b-f6c6-4b8b-a7b9-4ea85d3bbb40 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:05.885092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23458a2b-f6c6-4b8b-a7b9-4ea85d3bbb40 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:05.885192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23458a2b-f6c6-4b8b-a7b9-4ea85d3bbb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:05.957463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-23458a2b-f6c6-4b8b-a7b9-4ea85d3bbb40 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:05.958667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-23458a2b-f6c6-4b8b-a7b9-4ea85d3bbb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:06.068838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 587/1154] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:22:06.336266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326a0f-0160-41e8-97e5-9fed9e9d0826 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:22:06.338445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-52326a0f-0160-41e8-97e5-9fed9e9d0826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:06.478583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326a0f-0160-41e8-97e5-9fed9e9d0826 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:22:06.536955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:06.586487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eedabd-68ea-42ef-9441-63248bc0eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:22:06.587071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eedabd-68ea-42ef-9441-63248bc0eda4 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:06.587386 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eedabd-68ea-42ef-9441-63248bc0eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:06.587660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eedabd-68ea-42ef-9441-63248bc0eda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:06.588304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eedabd-68ea-42ef-9441-63248bc0eda4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:22:06.589419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-03eedabd-68ea-42ef-9441-63248bc0eda4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:22:06.589419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:22:06.589419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:22:06.590576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eedabd-68ea-42ef-9441-63248bc0eda4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:22:06.610743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 568/1155] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Oct 11 13:22:06 2022] GET /identity/v3/projects => generated 2553 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:22:08.744298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9378c-88d6-4acd-886d-63968e20f991 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:08.744920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9378c-88d6-4acd-886d-63968e20f991 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:08.744920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9378c-88d6-4acd-886d-63968e20f991 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:08.746167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 588/1156] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:22:08.751714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc6902-ade5-4b80-9e1b-3336814501f1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:08.752156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc6902-ade5-4b80-9e1b-3336814501f1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:08.752268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc6902-ade5-4b80-9e1b-3336814501f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:08.822596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6fcc6902-ade5-4b80-9e1b-3336814501f1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:08.823842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6fcc6902-ade5-4b80-9e1b-3336814501f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:08.931282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 569/1157] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:22:09.230093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9378c-88d6-4acd-886d-63968e20f991 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:22:09.232070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-42d9378c-88d6-4acd-886d-63968e20f991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:09.246979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:09.395042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9378c-88d6-4acd-886d-63968e20f991 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:22:09.478097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:09.511811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb106152-c086-4575-95e0-a2fa5a7d2883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:22:09.512411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb106152-c086-4575-95e0-a2fa5a7d2883 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:09.512683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb106152-c086-4575-95e0-a2fa5a7d2883 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:09.512953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb106152-c086-4575-95e0-a2fa5a7d2883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:09.514754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cb106152-c086-4575-95e0-a2fa5a7d2883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:09.607954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb106152-c086-4575-95e0-a2fa5a7d2883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:22:09.609457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb106152-c086-4575-95e0-a2fa5a7d2883 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:22:09.627721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 589/1158] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:22:11.922655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c145f34-5d72-40d7-a1ca-3543e04f3709 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:11.923300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c145f34-5d72-40d7-a1ca-3543e04f3709 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:11.923300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c145f34-5d72-40d7-a1ca-3543e04f3709 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:11.924565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 570/1159] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:22:11.930847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22d4ae-6412-48c3-b245-93fbc91ebd44 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:11.931320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22d4ae-6412-48c3-b245-93fbc91ebd44 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:11.931434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22d4ae-6412-48c3-b245-93fbc91ebd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:12.007360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3f22d4ae-6412-48c3-b245-93fbc91ebd44 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:12.008562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3f22d4ae-6412-48c3-b245-93fbc91ebd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:12.057734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:12.113642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 590/1160] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:22:12.413506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c145f34-5d72-40d7-a1ca-3543e04f3709 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:22:12.415149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1c145f34-5d72-40d7-a1ca-3543e04f3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:12.440256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:12.524437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c145f34-5d72-40d7-a1ca-3543e04f3709 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:22:12.602463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97f541-252a-4d32-aab9-c8aa6e2b7f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:22:12.603013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97f541-252a-4d32-aab9-c8aa6e2b7f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:12.603288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97f541-252a-4d32-aab9-c8aa6e2b7f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:12.603558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97f541-252a-4d32-aab9-c8aa6e2b7f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:12.605162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-dc97f541-252a-4d32-aab9-c8aa6e2b7f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:12.690283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:12.739054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97f541-252a-4d32-aab9-c8aa6e2b7f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:22:12.740563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97f541-252a-4d32-aab9-c8aa6e2b7f52 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:22:12.759823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 571/1161] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:22:14.936559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da596-1267-45df-bdf9-640103051072 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:14.937464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da596-1267-45df-bdf9-640103051072 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:14.937464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da596-1267-45df-bdf9-640103051072 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:14.939619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 591/1162] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:22:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:22:14.945311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9755e-b6ae-489c-9b0e-1e952089997d None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:14.945799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9755e-b6ae-489c-9b0e-1e952089997d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:14.946413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9755e-b6ae-489c-9b0e-1e952089997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:15.012276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-34a9755e-b6ae-489c-9b0e-1e952089997d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:15.013484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-34a9755e-b6ae-489c-9b0e-1e952089997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:15.114951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 572/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:22:15.400743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da596-1267-45df-bdf9-640103051072 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:22:15.403306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ee3da596-1267-45df-bdf9-640103051072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:15.514835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da596-1267-45df-bdf9-640103051072 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:22:15.591378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:15.592788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da9e31-327e-4a17-ad29-e5e1774d5645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:22:15.593396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9e31-327e-4a17-ad29-e5e1774d5645 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:15.593687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9e31-327e-4a17-ad29-e5e1774d5645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:15.593986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9e31-327e-4a17-ad29-e5e1774d5645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:15.596485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b0da9e31-327e-4a17-ad29-e5e1774d5645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:15.710032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da9e31-327e-4a17-ad29-e5e1774d5645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:22:15.711464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da9e31-327e-4a17-ad29-e5e1774d5645 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:22:15.729420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 592/1164] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:22:17.995359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088fba1-f303-4d30-8a2a-941b574c4a0c None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:17.995978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088fba1-f303-4d30-8a2a-941b574c4a0c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:17.995978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088fba1-f303-4d30-8a2a-941b574c4a0c None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:17.997265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 573/1165] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:22:18.004115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f58f4-8f53-4e0e-9b95-b9533b06d9cb None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:18.004832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f58f4-8f53-4e0e-9b95-b9533b06d9cb None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:18.004982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f58f4-8f53-4e0e-9b95-b9533b06d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:18.077908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-4e2f58f4-8f53-4e0e-9b95-b9533b06d9cb None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:18.079172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4e2f58f4-8f53-4e0e-9b95-b9533b06d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:18.133602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:18.180828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 593/1166] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:22:18.472767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088fba1-f303-4d30-8a2a-941b574c4a0c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:22:18.474358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a088fba1-f303-4d30-8a2a-941b574c4a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:18.515231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:18.586728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088fba1-f303-4d30-8a2a-941b574c4a0c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:22:18.672744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04e7ba-49b9-479b-aa59-384fd4855d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:22:18.673360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e7ba-49b9-479b-aa59-384fd4855d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:18.673635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e7ba-49b9-479b-aa59-384fd4855d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:18.673903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e7ba-49b9-479b-aa59-384fd4855d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:18.675607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6a04e7ba-49b9-479b-aa59-384fd4855d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:18.771755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:18.803440 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04e7ba-49b9-479b-aa59-384fd4855d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:22:18.804895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04e7ba-49b9-479b-aa59-384fd4855d6a service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:22:18.823264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 574/1167] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:22:21.144922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763849d-e766-458f-9bdb-80c13dc6f6ff None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:21.145507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763849d-e766-458f-9bdb-80c13dc6f6ff None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:21.145507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763849d-e766-458f-9bdb-80c13dc6f6ff None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:21.146879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 594/1168] 10.222.0.16 () {54 vars in 927 bytes} [Tue Oct 11 13:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:22:21.153267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef3c1-0394-42b6-a2f9-49727c1e596f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:21.153980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef3c1-0394-42b6-a2f9-49727c1e596f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:21.154132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef3c1-0394-42b6-a2f9-49727c1e596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:21.235244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-995ef3c1-0394-42b6-a2f9-49727c1e596f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:22:21.236430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-995ef3c1-0394-42b6-a2f9-49727c1e596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:21.349093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 575/1169] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Oct 11 13:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:22:21.639900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763849d-e766-458f-9bdb-80c13dc6f6ff None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:22:21.642446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a763849d-e766-458f-9bdb-80c13dc6f6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:21.765062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763849d-e766-458f-9bdb-80c13dc6f6ff None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:22:21.843821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bbc66-054f-4b43-9f89-cc4bd2bdb963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:22:21.844751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbc66-054f-4b43-9f89-cc4bd2bdb963 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:22:21.845027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbc66-054f-4b43-9f89-cc4bd2bdb963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:22:21.845293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbc66-054f-4b43-9f89-cc4bd2bdb963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:22:21.847062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-909bbc66-054f-4b43-9f89-cc4bd2bdb963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:22:21.857440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:21.967089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bbc66-054f-4b43-9f89-cc4bd2bdb963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:22:21.968533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bbc66-054f-4b43-9f89-cc4bd2bdb963 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:22:21.987091 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 595/1170] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:22:31.347236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=82 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:31.984833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=50 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:36.416422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:36.417660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:36.417660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:36.513874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:23:36.515141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:36.617000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 576/1171] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:23:36.625107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce68c1-4734-4007-a97c-989e453afc49 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:36.625617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce68c1-4734-4007-a97c-989e453afc49 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:36.625617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce68c1-4734-4007-a97c-989e453afc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:36.707513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-90ce68c1-4734-4007-a97c-989e453afc49 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:23:36.708736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-90ce68c1-4734-4007-a97c-989e453afc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:36.820057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 596/1172] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:23:36.825000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:36.826238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:36.837952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00a93f-e010-4850-af59-b4ab9166f904 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:36.901720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:36.936061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:36.936668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:36.936936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:36.937189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:36.937818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:23:36.938117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:36.939325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:23:36.939325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:23:36.939325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:23:36.940208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:36.952041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 577/1173] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:23:36.961882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce68c1-4734-4007-a97c-989e453afc49 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:36.971824 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce68c1-4734-4007-a97c-989e453afc49 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:37.042359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:37.080080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:37.080694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:37.080965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:37.081233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:37.081860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:37.082870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:23:37.082870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:23:37.082870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:23:37.084095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:37.152892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 597/1174] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:23:36 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:23:37.158578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:37.160146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:37.196369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bba09-4e16-425e-b92d-54305174c422 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:37.293401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:37.293989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:37.294265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:37.294532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:37.295195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:37.296391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:23:37.296391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:23:37.296391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:23:37.297354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:37.344557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 578/1175] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:23:37 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:23:37.349132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:37.350766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:37.415908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3536595-1bee-43a1-aeda-e7aa55251050 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:37.506621 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:37.518530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:37.519176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:37.519451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:37.519737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:37.520362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:37.521977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:37.534242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 598/1176] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:23:37.538526 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:37.540085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:37.552177 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e020d-ddcc-40b4-a82f-174c2e28ec15 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:37.579599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:37.651850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdf817-14bc-46a0-8095-caaa8f045ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:37.652539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdf817-14bc-46a0-8095-caaa8f045ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:37.652819 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdf817-14bc-46a0-8095-caaa8f045ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:37.653080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdf817-14bc-46a0-8095-caaa8f045ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:37.653722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdf817-14bc-46a0-8095-caaa8f045ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:37.655340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdf817-14bc-46a0-8095-caaa8f045ecc admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:37.668305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 579/1177] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:23:37.672789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:37.674376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:37.710691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695106f-9888-44dc-b62b-431c0ddb20e8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:37.810082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cfab1-5d8c-4ccb-b5c2-c97c0e2e81c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:37.810744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cfab1-5d8c-4ccb-b5c2-c97c0e2e81c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:37.811043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cfab1-5d8c-4ccb-b5c2-c97c0e2e81c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:37.811306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cfab1-5d8c-4ccb-b5c2-c97c0e2e81c6 admin admin] PATH_INFO: `/v3/projects/8485861bcc0c41b78681805461355ac8/users/10b1efa15d7949fcaa411ed0ef4cd987/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:37.843856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cfab1-5d8c-4ccb-b5c2-c97c0e2e81c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8485861bcc0c41b78681805461355ac8, user_id=10b1efa15d7949fcaa411ed0ef4cd987, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:37.847053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cfab1-5d8c-4ccb-b5c2-c97c0e2e81c6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:37.882031 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 599/1178] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:23:37 2022] PUT /identity/v3/projects/8485861bcc0c41b78681805461355ac8/users/10b1efa15d7949fcaa411ed0ef4cd987/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:23:37.893412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ddb1-1eea-4a23-9c3f-5f0d3adc0bda None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:37.893688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ddb1-1eea-4a23-9c3f-5f0d3adc0bda None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:37.893959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ddb1-1eea-4a23-9c3f-5f0d3adc0bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:37.952102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-58f3ddb1-1eea-4a23-9c3f-5f0d3adc0bda None None] MFA Rules not processed for user `10b1efa15d7949fcaa411ed0ef4cd987`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:23:37.953287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-58f3ddb1-1eea-4a23-9c3f-5f0d3adc0bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:38.036847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 580/1179] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:23:38.050736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf593b0-4d9f-489e-85c7-30c5e90d13cb None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:38.051048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf593b0-4d9f-489e-85c7-30c5e90d13cb None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:38.051321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf593b0-4d9f-489e-85c7-30c5e90d13cb None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:38.052661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 600/1180] 10.222.0.16 () {54 vars in 963 bytes} [Tue Oct 11 13:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:23:38.057597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa7732-85ab-4c47-a278-005d32491c27 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:38.057879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa7732-85ab-4c47-a278-005d32491c27 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:38.058145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa7732-85ab-4c47-a278-005d32491c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:38.092581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:38.137490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b3aa7732-85ab-4c47-a278-005d32491c27 None None] MFA Rules not processed for user `e466d119406f489b962596b7cd9fb7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:23:38.138694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b3aa7732-85ab-4c47-a278-005d32491c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:38.217767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 581/1181] 10.222.0.16 () {58 vars in 1060 bytes} [Tue Oct 11 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:23:38.225886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf593b0-4d9f-489e-85c7-30c5e90d13cb None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:38.227459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6cf593b0-4d9f-489e-85c7-30c5e90d13cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:38.282146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:38.343680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf593b0-4d9f-489e-85c7-30c5e90d13cb None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:38.419268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:38.419868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:38.420136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:38.420402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:38.421971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:38.534049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:38.535826 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:38.541363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:38.564553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 601/1182] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:23:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:23:38.610180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54138-cfd5-4955-af36-dbb51f83644e None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:38.610865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54138-cfd5-4955-af36-dbb51f83644e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:38.610865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54138-cfd5-4955-af36-dbb51f83644e None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:38.612011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 582/1183] 10.222.0.16 () {52 vars in 830 bytes} [Tue Oct 11 13:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:23:38.615919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:38.617143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:38.724748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adca94-df17-4a02-ae00-c40201374602 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:38.826764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:38.827345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:38.827618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:38.827885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] PATH_INFO: `/v3/users/10b1efa15d7949fcaa411ed0ef4cd987` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:38.841450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b1efa15d7949fcaa411ed0ef4cd987)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:38.842498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:23:38.842498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:23:38.842498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:23:38.843845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:38.854346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:38.912383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b1efa15d7949fcaa411ed0ef4cd987'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:38.927476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b1efa15d7949fcaa411ed0ef4cd987'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:38.927929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b1efa15d7949fcaa411ed0ef4cd987'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:38.928446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b1efa15d7949fcaa411ed0ef4cd987'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:38.940417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b1efa15d7949fcaa411ed0ef4cd987'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:38.969864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 602/1184] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:23:38 2022] DELETE /identity/v3/users/10b1efa15d7949fcaa411ed0ef4cd987 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:23:38.974622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:38.974927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:38.975189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:39.035900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:23:39.037111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:39.117982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:39.132345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 583/1185] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:23:39.142771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:39.144024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:39.248343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755d9d-0aec-400c-b153-481148275ba8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:39.305258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:39.325799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682d07-a0a4-4bcd-84f7-51e864a8dc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:39.326410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682d07-a0a4-4bcd-84f7-51e864a8dc10 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:39.326685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682d07-a0a4-4bcd-84f7-51e864a8dc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:39.326986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682d07-a0a4-4bcd-84f7-51e864a8dc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:39.328617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6e682d07-a0a4-4bcd-84f7-51e864a8dc10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:39.439723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e682d07-a0a4-4bcd-84f7-51e864a8dc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:39.441073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e682d07-a0a4-4bcd-84f7-51e864a8dc10 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:39.460726 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 603/1186] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:23:39.861573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:23:39.862862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:23:39.874801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35147-efe3-4d38-846f-4dd09365b3a3 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:23:39.970788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:23:39.971475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:23:39.971748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:23:39.972015 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] PATH_INFO: `/v3/projects/8485861bcc0c41b78681805461355ac8` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:23:39.981637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8485861bcc0c41b78681805461355ac8)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:23:39.982616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:23:39.982616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:23:39.982616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:23:39.983804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:23:40.052642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8485861bcc0c41b78681805461355ac8', 'request_id': 'req-999474a6-2960-4c7a-ad7e-364ca38d23b8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:40.063747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8485861bcc0c41b78681805461355ac8', 'request_id': 'req-999474a6-2960-4c7a-ad7e-364ca38d23b8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:40.077242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8485861bcc0c41b78681805461355ac8', 'request_id': 'req-999474a6-2960-4c7a-ad7e-364ca38d23b8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:40.100809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] The token cache is being invalidate because project 8485861bcc0c41b78681805461355ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:23:40.101092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:40.101522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-999474a6-2960-4c7a-ad7e-364ca38d23b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:23:40.102935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 584/1187] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:23:39 2022] DELETE /identity/v3/projects/8485861bcc0c41b78681805461355ac8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:23:49.458006 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=62 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:23:50.098263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:11.633117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f65b7-b842-4656-bf10-a9424d8b86ff None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:11.633681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f65b7-b842-4656-bf10-a9424d8b86ff None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:11.633681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f65b7-b842-4656-bf10-a9424d8b86ff None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:11.635625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 604/1188] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:11.643899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810138a5-9f61-4da8-a13f-e2cd1d9f1d1e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:11.644334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810138a5-9f61-4da8-a13f-e2cd1d9f1d1e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:11.644455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810138a5-9f61-4da8-a13f-e2cd1d9f1d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:11.739848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-810138a5-9f61-4da8-a13f-e2cd1d9f1d1e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:11.741865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-810138a5-9f61-4da8-a13f-e2cd1d9f1d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:11.850634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 585/1189] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:12.005302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f65b7-b842-4656-bf10-a9424d8b86ff None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:12.008296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-df0f65b7-b842-4656-bf10-a9424d8b86ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:12.138399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f65b7-b842-4656-bf10-a9424d8b86ff None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:12.144783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055585-6463-42c5-83e6-2bbb7b3952eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:12.145487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055585-6463-42c5-83e6-2bbb7b3952eb service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:12.145765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055585-6463-42c5-83e6-2bbb7b3952eb service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:12.146035 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055585-6463-42c5-83e6-2bbb7b3952eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:12.154781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055585-6463-42c5-83e6-2bbb7b3952eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:12.156410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055585-6463-42c5-83e6-2bbb7b3952eb service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:12.165748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 605/1190] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:13.248180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588808-8fe3-400c-a7dc-6036af04280c None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:13.248676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588808-8fe3-400c-a7dc-6036af04280c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:13.248676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588808-8fe3-400c-a7dc-6036af04280c None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:13.250103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 586/1191] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:13.257440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca137f-8d91-4e0f-b6ff-7269e915f4a0 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:13.257917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca137f-8d91-4e0f-b6ff-7269e915f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:13.258014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca137f-8d91-4e0f-b6ff-7269e915f4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:13.283204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-26ca137f-8d91-4e0f-b6ff-7269e915f4a0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:13.284427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-26ca137f-8d91-4e0f-b6ff-7269e915f4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:13.294286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 606/1192] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:13.447106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588808-8fe3-400c-a7dc-6036af04280c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:13.462664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588808-8fe3-400c-a7dc-6036af04280c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:13.469382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a342d-741d-4ce4-88ad-03a8e70e8300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:13.470203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a342d-741d-4ce4-88ad-03a8e70e8300 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:13.470355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a342d-741d-4ce4-88ad-03a8e70e8300 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:13.470548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a342d-741d-4ce4-88ad-03a8e70e8300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:13.479860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a342d-741d-4ce4-88ad-03a8e70e8300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:13.481687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a342d-741d-4ce4-88ad-03a8e70e8300 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:13.492068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 587/1193] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:13.859260 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e207-9c99-43f8-933d-fc303fc3b495 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:13.859471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e207-9c99-43f8-933d-fc303fc3b495 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:13.859701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e207-9c99-43f8-933d-fc303fc3b495 None None] PATH_INFO: `/v3` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:13.860991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 607/1194] 10.222.0.30 () {54 vars in 925 bytes} [Tue Oct 11 13:25:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:25:13.868113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4ae2-4344-47f7-8d07-9eb9b39eeb2f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:13.868395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4ae2-4344-47f7-8d07-9eb9b39eeb2f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:13.868661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4ae2-4344-47f7-8d07-9eb9b39eeb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:13.933394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fada4ae2-4344-47f7-8d07-9eb9b39eeb2f None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:13.934603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fada4ae2-4344-47f7-8d07-9eb9b39eeb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:13.952021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:14.010184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 588/1195] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 11 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:17.735079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf701dd-c30f-45a7-8ccd-ab5e2f0fb793 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:17.735607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf701dd-c30f-45a7-8ccd-ab5e2f0fb793 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:17.735607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf701dd-c30f-45a7-8ccd-ab5e2f0fb793 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:17.737972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 608/1196] 10.222.0.16 () {54 vars in 961 bytes} [Tue Oct 11 13:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:17.743365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f1f5-d529-4461-b177-cf1f6c8e97ed None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:17.743986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f1f5-d529-4461-b177-cf1f6c8e97ed None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:17.743986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f1f5-d529-4461-b177-cf1f6c8e97ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:17.766656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-7fd0f1f5-d529-4461-b177-cf1f6c8e97ed None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:17.767921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7fd0f1f5-d529-4461-b177-cf1f6c8e97ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:17.777712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 589/1197] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Oct 11 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:17.785587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf701dd-c30f-45a7-8ccd-ab5e2f0fb793 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:17.801352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf701dd-c30f-45a7-8ccd-ab5e2f0fb793 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:17.807386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f261-52de-4947-af99-cfe833465a53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:17.807984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f261-52de-4947-af99-cfe833465a53 service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:17.808259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f261-52de-4947-af99-cfe833465a53 service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:17.808532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f261-52de-4947-af99-cfe833465a53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:17.817089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f261-52de-4947-af99-cfe833465a53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:17.818681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f261-52de-4947-af99-cfe833465a53 service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:17.828503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 609/1198] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:24.969425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9ae1-d3b6-4b8c-95d2-61f71054c4a0 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:24.969957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9ae1-d3b6-4b8c-95d2-61f71054c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:24.970064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9ae1-d3b6-4b8c-95d2-61f71054c4a0 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:24.972174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 590/1199] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:24.981080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d954a-262a-4f56-b545-6468b87401b2 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:24.981617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d954a-262a-4f56-b545-6468b87401b2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:24.981617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d954a-262a-4f56-b545-6468b87401b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:25.002209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-938d954a-262a-4f56-b545-6468b87401b2 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:25.003451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-938d954a-262a-4f56-b545-6468b87401b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:25.012191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 610/1200] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:25.167104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9ae1-d3b6-4b8c-95d2-61f71054c4a0 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:25.188132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9ae1-d3b6-4b8c-95d2-61f71054c4a0 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:25.194361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1097f-dab2-42dd-bb96-7adc542e9c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:25.194990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1097f-dab2-42dd-bb96-7adc542e9c1d service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:25.195262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1097f-dab2-42dd-bb96-7adc542e9c1d service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:25.195528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1097f-dab2-42dd-bb96-7adc542e9c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:25.203790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1097f-dab2-42dd-bb96-7adc542e9c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:25.205364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1097f-dab2-42dd-bb96-7adc542e9c1d service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:25.215075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 591/1201] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:26.284030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8e40-e28a-4c1b-a14a-a5f0f56dfde7 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:26.284987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8e40-e28a-4c1b-a14a-a5f0f56dfde7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:26.284987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8e40-e28a-4c1b-a14a-a5f0f56dfde7 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:26.286887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 611/1202] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 13:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:26.295218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dba63-5699-42ea-8e51-1d595e466a38 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:26.295700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dba63-5699-42ea-8e51-1d595e466a38 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:26.295801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dba63-5699-42ea-8e51-1d595e466a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:26.316609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-592dba63-5699-42ea-8e51-1d595e466a38 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:26.317799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-592dba63-5699-42ea-8e51-1d595e466a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:26.326329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 592/1203] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:25:26.479892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b8e40-e28a-4c1b-a14a-a5f0f56dfde7 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:26.501286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b8e40-e28a-4c1b-a14a-a5f0f56dfde7 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:26.507684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a0915-f3e6-404d-8976-815ec3070399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:26.508296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0915-f3e6-404d-8976-815ec3070399 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:26.508594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0915-f3e6-404d-8976-815ec3070399 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:26.508844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0915-f3e6-404d-8976-815ec3070399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:26.517755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a0915-f3e6-404d-8976-815ec3070399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:26.519374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a0915-f3e6-404d-8976-815ec3070399 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:26.530204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 612/1204] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:30.554878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777ccd-58f6-4bfe-ad8f-3386c536dcee None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:30.555808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777ccd-58f6-4bfe-ad8f-3386c536dcee None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:30.555946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777ccd-58f6-4bfe-ad8f-3386c536dcee None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:30.557275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 593/1205] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:30.562840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a3c2-d429-4eed-bd29-f4d5aa2d608e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:30.563287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a3c2-d429-4eed-bd29-f4d5aa2d608e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:30.563382 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a3c2-d429-4eed-bd29-f4d5aa2d608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:30.584827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c5b5a3c2-d429-4eed-bd29-f4d5aa2d608e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:30.586071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c5b5a3c2-d429-4eed-bd29-f4d5aa2d608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:30.594602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 613/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:30.882446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777ccd-58f6-4bfe-ad8f-3386c536dcee None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:30.885251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bd777ccd-58f6-4bfe-ad8f-3386c536dcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:30.966456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777ccd-58f6-4bfe-ad8f-3386c536dcee None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:30.970411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7742-d299-4c0f-ae0b-eeda66683e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:30.971047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7742-d299-4c0f-ae0b-eeda66683e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:30.971322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7742-d299-4c0f-ae0b-eeda66683e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:30.971592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7742-d299-4c0f-ae0b-eeda66683e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:30.980995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7742-d299-4c0f-ae0b-eeda66683e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:30.982412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7742-d299-4c0f-ae0b-eeda66683e9b service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:30.992081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 594/1207] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:33.095733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a18a-4b8c-49ad-ae43-28b26636eafc None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:33.096379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a18a-4b8c-49ad-ae43-28b26636eafc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:33.096379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a18a-4b8c-49ad-ae43-28b26636eafc None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:33.097624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 614/1208] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:33.104406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadeade-8796-41e9-ae00-c4247a9614c7 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:33.104831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadeade-8796-41e9-ae00-c4247a9614c7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:33.104948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadeade-8796-41e9-ae00-c4247a9614c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:33.135789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4eadeade-8796-41e9-ae00-c4247a9614c7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:33.136983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4eadeade-8796-41e9-ae00-c4247a9614c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:33.145466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 595/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:33.434545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981a18a-4b8c-49ad-ae43-28b26636eafc None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:33.452069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981a18a-4b8c-49ad-ae43-28b26636eafc None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:33.458210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b5be-e546-4c48-b82a-f5e1af7b9d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:33.459098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b5be-e546-4c48-b82a-f5e1af7b9d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:33.459446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b5be-e546-4c48-b82a-f5e1af7b9d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:33.459812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b5be-e546-4c48-b82a-f5e1af7b9d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:33.469794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b5be-e546-4c48-b82a-f5e1af7b9d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:33.471270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b5be-e546-4c48-b82a-f5e1af7b9d32 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:33.480616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 615/1210] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:36.984222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4dba9-fa87-424d-ba25-7e3325846809 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:36.985124 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4dba9-fa87-424d-ba25-7e3325846809 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:36.985124 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4dba9-fa87-424d-ba25-7e3325846809 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:36.987262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 596/1211] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:25:36.995656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5203-20c7-4110-978d-b91a11120022 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:36.996103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5203-20c7-4110-978d-b91a11120022 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:36.996208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5203-20c7-4110-978d-b91a11120022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:37.017562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-8afc5203-20c7-4110-978d-b91a11120022 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:37.018782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8afc5203-20c7-4110-978d-b91a11120022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:37.027739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 616/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:25:37.323531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4dba9-fa87-424d-ba25-7e3325846809 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:37.326307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3da4dba9-fa87-424d-ba25-7e3325846809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:37.398474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:37.413380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4dba9-fa87-424d-ba25-7e3325846809 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:37.417488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622789a-650d-4f69-bd73-0163ddbc97a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:37.418103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622789a-650d-4f69-bd73-0163ddbc97a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:37.418377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622789a-650d-4f69-bd73-0163ddbc97a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:37.418647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622789a-650d-4f69-bd73-0163ddbc97a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:37.427897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622789a-650d-4f69-bd73-0163ddbc97a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:37.429351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622789a-650d-4f69-bd73-0163ddbc97a0 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:37.438664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 597/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:39.591547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843380d-4ca8-49a6-84c8-2a5836290325 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:39.592097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843380d-4ca8-49a6-84c8-2a5836290325 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:39.592097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843380d-4ca8-49a6-84c8-2a5836290325 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:39.593356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 617/1214] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 13:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:25:39.599822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9a404-c1b2-426c-965d-0a837a66e369 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:39.600291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9a404-c1b2-426c-965d-0a837a66e369 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:39.600389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9a404-c1b2-426c-965d-0a837a66e369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:39.627712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6fd9a404-c1b2-426c-965d-0a837a66e369 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:25:39.628922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6fd9a404-c1b2-426c-965d-0a837a66e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:39.639325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 598/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 13:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:25:39.943850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843380d-4ca8-49a6-84c8-2a5836290325 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:25:39.946770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4843380d-4ca8-49a6-84c8-2a5836290325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:25:39.955594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=84 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:39.962127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843380d-4ca8-49a6-84c8-2a5836290325 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:25:39.965957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc1b51-412b-4d17-af1f-a02d7f9d7212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:25:39.966571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1b51-412b-4d17-af1f-a02d7f9d7212 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:25:39.966857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1b51-412b-4d17-af1f-a02d7f9d7212 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:25:39.967118 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1b51-412b-4d17-af1f-a02d7f9d7212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:25:39.976329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc1b51-412b-4d17-af1f-a02d7f9d7212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:25:39.978068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc1b51-412b-4d17-af1f-a02d7f9d7212 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:25:39.988113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 618/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:25:49.622666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=11 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:49.983937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:09.772270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabf22-ff92-4fbf-be5b-9f8e9904ded7 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:09.775140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabf22-ff92-4fbf-be5b-9f8e9904ded7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:09.775140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabf22-ff92-4fbf-be5b-9f8e9904ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:09.799387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-77dabf22-ff92-4fbf-be5b-9f8e9904ded7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:09.801191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-77dabf22-ff92-4fbf-be5b-9f8e9904ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:09.813659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 599/1217] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:09.825078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d50b1-7807-4321-a312-92fb2582bc15 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:09.825995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d50b1-7807-4321-a312-92fb2582bc15 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:09.826424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d50b1-7807-4321-a312-92fb2582bc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:09.849051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c475a5-5e1a-4b86-8d14-13c65791f286 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:09.849794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c475a5-5e1a-4b86-8d14-13c65791f286 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:09.850895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c475a5-5e1a-4b86-8d14-13c65791f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:09.855410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f92d50b1-7807-4321-a312-92fb2582bc15 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:09.856604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f92d50b1-7807-4321-a312-92fb2582bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:09.872933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 619/1218] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:09.877746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d50b1-7807-4321-a312-92fb2582bc15 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:09.887125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-86c475a5-5e1a-4b86-8d14-13c65791f286 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:09.888932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-86c475a5-5e1a-4b86-8d14-13c65791f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:09.889985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d50b1-7807-4321-a312-92fb2582bc15 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:09.903650 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:09.904569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:09.904854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:09.905126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:09.905798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:09.906095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:09.907163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:27:09.907163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:27:09.907163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:27:09.908100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:09.908276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 600/1219] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:09.919910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b476-fc0f-43c5-8f02-b7c266157fcc None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:09.920568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b476-fc0f-43c5-8f02-b7c266157fcc None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:09.921167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b476-fc0f-43c5-8f02-b7c266157fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:09.929284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 620/1220] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:27:09.937930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:09.958356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fba5b476-fc0f-43c5-8f02-b7c266157fcc None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:09.959375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4137cd1-0196-4803-94e3-4ea2046f172a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:09.960109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fba5b476-fc0f-43c5-8f02-b7c266157fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:09.971700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:09.972341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:09.972617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:09.972883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:09.973525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:09.975519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:09.978690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 601/1221] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:09.984286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b476-fc0f-43c5-8f02-b7c266157fcc None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.001300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b476-fc0f-43c5-8f02-b7c266157fcc None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.013630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.014717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.015188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.015621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.016419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:10.017608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.019926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.039017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 602/1222] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:27:10.049554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.050479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 621/1223] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:09 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:10.054781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.064880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9dea6-0386-4091-8db9-57d8e232cc18 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.160759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876b3f-9f93-4b31-8515-f21f2c556a8c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.169961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027ba19-0d31-4d15-b691-a67c52a9e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.170588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027ba19-0d31-4d15-b691-a67c52a9e170 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.170894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027ba19-0d31-4d15-b691-a67c52a9e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.171165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027ba19-0d31-4d15-b691-a67c52a9e170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.172022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027ba19-0d31-4d15-b691-a67c52a9e170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.173037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-e027ba19-0d31-4d15-b691-a67c52a9e170 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:27:10.173037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:27:10.173037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:27:10.174227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027ba19-0d31-4d15-b691-a67c52a9e170 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.176560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0e191-3175-4707-8757-3d7acf261207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.177186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0e191-3175-4707-8757-3d7acf261207 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.177458 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0e191-3175-4707-8757-3d7acf261207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.177719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0e191-3175-4707-8757-3d7acf261207 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.178353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0e191-3175-4707-8757-3d7acf261207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.179388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-d9a0e191-3175-4707-8757-3d7acf261207 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:27:10.179388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:27:10.179388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:27:10.180584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0e191-3175-4707-8757-3d7acf261207 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.230105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 622/1224] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:10.232355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f072e-e593-4d3c-b1ea-f5fcc753acd6 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.233603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f072e-e593-4d3c-b1ea-f5fcc753acd6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.233891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f072e-e593-4d3c-b1ea-f5fcc753acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.244563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 603/1225] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:10.246013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c218ce-ae16-44f1-9dec-d57255acbf5b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.246286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c218ce-ae16-44f1-9dec-d57255acbf5b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.246546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c218ce-ae16-44f1-9dec-d57255acbf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.276283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-799f072e-e593-4d3c-b1ea-f5fcc753acd6 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.277497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-799f072e-e593-4d3c-b1ea-f5fcc753acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.288081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-39c218ce-ae16-44f1-9dec-d57255acbf5b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.289349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-39c218ce-ae16-44f1-9dec-d57255acbf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.362914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 623/1226] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.364208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a051-2b31-4fd5-bac6-50b1984bb62f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.364493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a051-2b31-4fd5-bac6-50b1984bb62f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.364773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a051-2b31-4fd5-bac6-50b1984bb62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.375515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 604/1227] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.376675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c218ce-ae16-44f1-9dec-d57255acbf5b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.384985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-54a7a051-2b31-4fd5-bac6-50b1984bb62f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.386193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-54a7a051-2b31-4fd5-bac6-50b1984bb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.388041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c218ce-ae16-44f1-9dec-d57255acbf5b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.393185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb70b1b-da4f-428a-91f8-87e373b6a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.393896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70b1b-da4f-428a-91f8-87e373b6a2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.394172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70b1b-da4f-428a-91f8-87e373b6a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.394439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70b1b-da4f-428a-91f8-87e373b6a2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.395096 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb70b1b-da4f-428a-91f8-87e373b6a2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.395858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 624/1228] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.396469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7a051-2b31-4fd5-bac6-50b1984bb62f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.404350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb70b1b-da4f-428a-91f8-87e373b6a2d8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.410365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7a051-2b31-4fd5-bac6-50b1984bb62f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.415675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6481f5-17b7-4aeb-b01b-3e476e12c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.416219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6481f5-17b7-4aeb-b01b-3e476e12c965 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.416559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6481f5-17b7-4aeb-b01b-3e476e12c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.417157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6481f5-17b7-4aeb-b01b-3e476e12c965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.417929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6481f5-17b7-4aeb-b01b-3e476e12c965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.419895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6481f5-17b7-4aeb-b01b-3e476e12c965 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.433313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 605/1229] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/users => generated 288 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:10.433733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 625/1230] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:10.435044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c6b4-3d17-4844-ab2f-6806234e0448 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.435175 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c13f20-51e2-4c5d-84b9-2c7c98881525 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.435376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c13f20-51e2-4c5d-84b9-2c7c98881525 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.435715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c13f20-51e2-4c5d-84b9-2c7c98881525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.435882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c6b4-3d17-4844-ab2f-6806234e0448 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.436741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c6b4-3d17-4844-ab2f-6806234e0448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.456442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a8c13f20-51e2-4c5d-84b9-2c7c98881525 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.457835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a8c13f20-51e2-4c5d-84b9-2c7c98881525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.461536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9be4c6b4-3d17-4844-ab2f-6806234e0448 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.462758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9be4c6b4-3d17-4844-ab2f-6806234e0448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.465817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 626/1231] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.467076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc6b8-4ba6-492b-8636-c7efde258bc7 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.467359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc6b8-4ba6-492b-8636-c7efde258bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.467629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc6b8-4ba6-492b-8636-c7efde258bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.472108 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 606/1232] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.473299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2bf9-af99-430e-aaf9-058e03225754 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.473580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2bf9-af99-430e-aaf9-058e03225754 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.473853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2bf9-af99-430e-aaf9-058e03225754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.489690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5d3fc6b8-4ba6-492b-8636-c7efde258bc7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.490917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5d3fc6b8-4ba6-492b-8636-c7efde258bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.493830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-487b2bf9-af99-430e-aaf9-058e03225754 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.495186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-487b2bf9-af99-430e-aaf9-058e03225754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.500105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 627/1233] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.501339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc7611-aff9-4c21-8393-8d2fe29b4a11 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.501617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc7611-aff9-4c21-8393-8d2fe29b4a11 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.501887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc7611-aff9-4c21-8393-8d2fe29b4a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.507094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 607/1234] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.508990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce65fcb-77c0-43d1-9433-55ddbe952bc8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.509269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce65fcb-77c0-43d1-9433-55ddbe952bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.509542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce65fcb-77c0-43d1-9433-55ddbe952bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.521950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-31dc7611-aff9-4c21-8393-8d2fe29b4a11 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.523198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-31dc7611-aff9-4c21-8393-8d2fe29b4a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.528585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1ce65fcb-77c0-43d1-9433-55ddbe952bc8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.529741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1ce65fcb-77c0-43d1-9433-55ddbe952bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.531151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 628/1235] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.531929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc7611-aff9-4c21-8393-8d2fe29b4a11 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.536888 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:10.538539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 608/1236] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.539443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce65fcb-77c0-43d1-9433-55ddbe952bc8 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.547703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc7611-aff9-4c21-8393-8d2fe29b4a11 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.553452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce65fcb-77c0-43d1-9433-55ddbe952bc8 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.553597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1181d-bff8-4e05-82b3-5e0fbecd2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.554092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1181d-bff8-4e05-82b3-5e0fbecd2553 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.554376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1181d-bff8-4e05-82b3-5e0fbecd2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.554644 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1181d-bff8-4e05-82b3-5e0fbecd2553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.555323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1181d-bff8-4e05-82b3-5e0fbecd2553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.556919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1181d-bff8-4e05-82b3-5e0fbecd2553 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.558782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f7485-8786-43f0-9fc0-fede39cd935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.559424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7485-8786-43f0-9fc0-fede39cd935f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.559703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7485-8786-43f0-9fc0-fede39cd935f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.559977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7485-8786-43f0-9fc0-fede39cd935f admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.560618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f7485-8786-43f0-9fc0-fede39cd935f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.562202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f7485-8786-43f0-9fc0-fede39cd935f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.567241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 629/1237] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:10.568427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ddc81-e904-4e0a-a5f1-eb9663b14ae2 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.568706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ddc81-e904-4e0a-a5f1-eb9663b14ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.568977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ddc81-e904-4e0a-a5f1-eb9663b14ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.575717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 609/1238] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:10.577188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ab3a-f6c8-45d4-9ec7-37fa87f70a3a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.578319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ab3a-f6c8-45d4-9ec7-37fa87f70a3a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.579239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ab3a-f6c8-45d4-9ec7-37fa87f70a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.588261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-423ddc81-e904-4e0a-a5f1-eb9663b14ae2 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.589169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:10.589425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-423ddc81-e904-4e0a-a5f1-eb9663b14ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.597512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 630/1239] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.598313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ddc81-e904-4e0a-a5f1-eb9663b14ae2 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.602400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d7e3ab3a-f6c8-45d4-9ec7-37fa87f70a3a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.603654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d7e3ab3a-f6c8-45d4-9ec7-37fa87f70a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.607583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ddc81-e904-4e0a-a5f1-eb9663b14ae2 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.611638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 610/1240] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.612640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3ab3a-f6c8-45d4-9ec7-37fa87f70a3a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.615619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.616374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.616658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.617055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.617585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:10.618198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.619547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.627118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3ab3a-f6c8-45d4-9ec7-37fa87f70a3a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.632135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb6f04-3b32-49a5-bf8e-e1492d65e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.632746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb6f04-3b32-49a5-bf8e-e1492d65e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.633029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb6f04-3b32-49a5-bf8e-e1492d65e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.633297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb6f04-3b32-49a5-bf8e-e1492d65e0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.640750 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 631/1241] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:10.640908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb6f04-3b32-49a5-bf8e-e1492d65e0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:10.640908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb6f04-3b32-49a5-bf8e-e1492d65e0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.641086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.641165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb6f04-3b32-49a5-bf8e-e1492d65e0a3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.647907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 611/1242] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:10.649105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1b518-36e1-48f4-a801-d8902880e0da None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.649385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1b518-36e1-48f4-a801-d8902880e0da None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.649658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1b518-36e1-48f4-a801-d8902880e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.652867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2ff0-2102-4602-bfad-26ec1b89d7ea admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.658395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.659078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.659358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.659621 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.660254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:10.660549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.662196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.669135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-40b1b518-36e1-48f4-a801-d8902880e0da None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:10.670326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-40b1b518-36e1-48f4-a801-d8902880e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:10.674680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 632/1243] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:10.675635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.683737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 612/1244] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:10.684667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1b518-36e1-48f4-a801-d8902880e0da None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.687036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef80836-944a-4e73-93a5-7ae416daca6f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.691715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.692302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.692577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.692841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.693466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.694725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1b518-36e1-48f4-a801-d8902880e0da None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.695067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.699595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.700245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.700523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.700791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] PATH_INFO: `/v3/projects/0b45ac84da64465c82b415c62650c3c4/users/e1087a14fa6343c680c16d9456d96ce7/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.704846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 633/1245] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:10.705614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.717093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b45ac84da64465c82b415c62650c3c4, user_id=e1087a14fa6343c680c16d9456d96ce7, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.717377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa7a6-7566-40c0-bc17-5ebdf2c68661 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.719766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.722227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.723262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.723702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.724022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.724827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:10.725242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.727186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.733603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 613/1246] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:10 2022] PUT /identity/v3/projects/0b45ac84da64465c82b415c62650c3c4/users/e1087a14fa6343c680c16d9456d96ce7/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:10.734559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.743933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 634/1247] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:10.744811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.754424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa86f-00ee-4b9a-96b1-b6c0f4af3ab7 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.801654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6078c9-0743-4d09-9192-2a1cfe36de90 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.806660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.807312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.807606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.807873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.808538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:10.808844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.810473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.812233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.812830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.813106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.813372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.813995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.816061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.822650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 614/1248] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:10.823315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.835408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05b5c3-1392-42f0-a478-c69ece4cbadb admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.840669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.841274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.841552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.841822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.842450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.847210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 635/1249] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:10.847744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.847857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.874283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 615/1250] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:10.874283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.908012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b48d-0501-4d38-873d-cabf047860d4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.932429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:10.936813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf6ba5-43fa-4a46-95a8-59e0badc5302 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.942590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.943234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.943669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.943944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.944649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:10.944914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.946501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.958598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 616/1251] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:10.959513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:10.969159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e70c-1432-4348-b07e-050ce30ed1ec admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:10.972894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f9428-e9e6-4545-b31b-35eb1eb2d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.973513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f9428-e9e6-4545-b31b-35eb1eb2d07f admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.973635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:10.973787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f9428-e9e6-4545-b31b-35eb1eb2d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.974048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f9428-e9e6-4545-b31b-35eb1eb2d07f admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.974248 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:10.974519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:10.974677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f9428-e9e6-4545-b31b-35eb1eb2d07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.974780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] PATH_INFO: `/v3/projects/a449b4373e3f4fffa42e08409da763ba/users/2bc6ddeabddc438f8205b9125f9357a9/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:10.976637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f9428-e9e6-4545-b31b-35eb1eb2d07f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.989898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a449b4373e3f4fffa42e08409da763ba, user_id=2bc6ddeabddc438f8205b9125f9357a9, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:10.992556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:10.995682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:11.005556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 636/1252] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:10 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.006832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122a7a6-4dea-43a5-9614-ea4a5770bf70 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.007163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122a7a6-4dea-43a5-9614-ea4a5770bf70 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.007433 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122a7a6-4dea-43a5-9614-ea4a5770bf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.007666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 617/1253] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:10 2022] PUT /identity/v3/projects/a449b4373e3f4fffa42e08409da763ba/users/2bc6ddeabddc438f8205b9125f9357a9/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:11.008428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.027073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1122a7a6-4dea-43a5-9614-ea4a5770bf70 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:11.028305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1122a7a6-4dea-43a5-9614-ea4a5770bf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:11.073027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c5ade-96e5-4d97-bd9e-2e93ff308204 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.088483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 637/1254] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:11.092542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122a7a6-4dea-43a5-9614-ea4a5770bf70 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.101778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122a7a6-4dea-43a5-9614-ea4a5770bf70 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.106296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.106929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.107202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.107465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.108107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.110004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.132549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.133189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.133459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.133721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.134350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.136597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.141128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 638/1255] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.143790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.164353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 618/1256] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.165455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.208666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa257c6-3e6e-484f-8863-3a8ffbde80d6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.227541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e9630-23ec-403a-9fcb-44c6f55a41a7 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.232221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.232828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.233111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.233361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.233980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.235947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.243450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:11.261730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 619/1257] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.261730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.268793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e26b9d-4e8d-41a6-8cbe-284569156821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.269338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed068da-cf5a-4669-8b16-c4f6330cd901 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.269451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e26b9d-4e8d-41a6-8cbe-284569156821 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.269677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e26b9d-4e8d-41a6-8cbe-284569156821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.269951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e26b9d-4e8d-41a6-8cbe-284569156821 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.270571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e26b9d-4e8d-41a6-8cbe-284569156821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.272550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e26b9d-4e8d-41a6-8cbe-284569156821 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.274666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.275523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.275830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.276056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.276727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.278631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.294636 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 639/1258] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.296115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222253b9-fef0-4138-a40e-a8880e5516a3 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.296709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222253b9-fef0-4138-a40e-a8880e5516a3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.296709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222253b9-fef0-4138-a40e-a8880e5516a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.297605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:11.311408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 620/1259] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.312206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.326107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-222253b9-fef0-4138-a40e-a8880e5516a3 None None] MFA Rules not processed for user `2bc6ddeabddc438f8205b9125f9357a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:11.327664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-222253b9-fef0-4138-a40e-a8880e5516a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:11.377357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831e1ad-6de7-4445-95e9-30de03789ba7 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.382044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.382811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.383126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.383388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.384040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.385965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.391695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 640/1260] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:11.392609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222253b9-fef0-4138-a40e-a8880e5516a3 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.413977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 621/1261] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.413977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.423704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe84756-62fc-4517-9fd3-c68a681c019a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.428895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.429506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.429787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.430057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.430688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.432662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.454024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222253b9-fef0-4138-a40e-a8880e5516a3 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.455317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 622/1262] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.456205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.460834 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.461679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.461952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.462790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.465864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b590304-1a4f-4d42-b47b-0e27766fd062 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.470395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.471026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.471303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.471619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.472235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.472333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.473700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.474142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.483263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 641/1263] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:11.483879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.493626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8826-1002-4a9c-ada0-d0c2eb8eb120 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.498478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.501757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 623/1264] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/users => generated 282 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.501864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.501864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.501864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.502079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.502162 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.502162 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.512982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff115d-23a8-4dd8-943f-db2dfa647266 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.516028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 642/1265] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.517101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.520926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.521542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.521839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.522094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.522737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.524353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.528217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a93ef-1f5f-4b53-b105-0542dcb9d096 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.537900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 624/1266] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.538067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ff015-e841-4ab3-93f7-e07d59db6a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.538067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff015-e841-4ab3-93f7-e07d59db6a20 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.538272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.538357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff015-e841-4ab3-93f7-e07d59db6a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.538357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff015-e841-4ab3-93f7-e07d59db6a20 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.538357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ff015-e841-4ab3-93f7-e07d59db6a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.539830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ff015-e841-4ab3-93f7-e07d59db6a20 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.548221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7597-0d00-439b-983d-857fcfeeabac admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.554979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.555692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.556076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.556321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.557093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.558859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.564691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 643/1267] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/users => generated 283 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:11.566467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cd68-17b8-41d2-a0a0-3bb439934eba None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.566976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cd68-17b8-41d2-a0a0-3bb439934eba None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.567510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cd68-17b8-41d2-a0a0-3bb439934eba None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.568974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 644/1268] 10.222.0.16 () {54 vars in 961 bytes} [Tue Oct 11 13:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:11.569950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391cd68-17b8-41d2-a0a0-3bb439934eba None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.573027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 625/1269] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.573027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.583469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49082cec-d7df-43eb-baac-32850c640c13 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.588416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.589032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.589305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.589488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391cd68-17b8-41d2-a0a0-3bb439934eba None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.589605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.590202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.591813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.595394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.596250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.596552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.596898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.597539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.599236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.602953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 626/1270] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.604157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.610481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 645/1271] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.611358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.615970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04cf7b-09b5-44d5-851b-3068c0290ecb admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.621379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.622244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c412a2-f8e6-4c7e-8513-956cb17cd39e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.622608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.623247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.623807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.624726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.626755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.626979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.627565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.627958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.628232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.628862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.630456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.639149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 627/1272] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.639889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.643981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 646/1273] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.644715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.651688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e5602-a254-4d17-909e-6dea514abc50 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.654865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca539-9d12-44f4-8fe1-e647a92cc4c3 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.657908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18f6bc-afb0-498f-98fa-4cf6605cca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.658547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18f6bc-afb0-498f-98fa-4cf6605cca5f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.659016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18f6bc-afb0-498f-98fa-4cf6605cca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.659394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18f6bc-afb0-498f-98fa-4cf6605cca5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.660259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18f6bc-afb0-498f-98fa-4cf6605cca5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.660988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.661569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.661848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.661974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18f6bc-afb0-498f-98fa-4cf6605cca5f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.662166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.663018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.664882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.667894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:11.673586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 628/1274] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.675274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ae1e-b387-4430-8590-9c0bbb15d98f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.675712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ae1e-b387-4430-8590-9c0bbb15d98f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.675956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ae1e-b387-4430-8590-9c0bbb15d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.689493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 647/1275] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.689493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.699899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c01b34-2c8c-485f-a9e5-1978d42d1981 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.705412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.706552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.706840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.707346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.708294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.711401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.719437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b5c3ae1e-b387-4430-8590-9c0bbb15d98f None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:11.720780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b5c3ae1e-b387-4430-8590-9c0bbb15d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:11.724532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 648/1276] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.728169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.740094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e970b7-7dd7-4311-ad28-8e73fbfe926b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.745915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.746874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.747506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.748115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.748660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.750254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.761213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 649/1277] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.762155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.765037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:11.773026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f542-e351-48cc-a660-6c432b215c5c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.778177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.778955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.779233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.779508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] PATH_INFO: `/v3/projects/491c8d17e84149eea4d71675631f52d5/users/18ae891c0f6742caaa94c3673f03628c/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.795132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491c8d17e84149eea4d71675631f52d5, user_id=18ae891c0f6742caaa94c3673f03628c, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.796630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 629/1278] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Oct 11 13:27:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:11.797587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ae1e-b387-4430-8590-9c0bbb15d98f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.798228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.808286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ae1e-b387-4430-8590-9c0bbb15d98f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.814222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 650/1279] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:11 2022] PUT /identity/v3/projects/491c8d17e84149eea4d71675631f52d5/users/18ae891c0f6742caaa94c3673f03628c/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:11.815137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.893044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.894045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.894417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.894782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] PATH_INFO: `/v3/projects/bd3bd067440f4953920348efaafe66fa/users/f150cba7959d44aaa1f2fa1c45f3cee3/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.902367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d4b3-74d8-4d9a-bd9c-01c42c363fb3 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.907878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:11.908505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:11.908807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:11.909107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:11.909807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.911478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.920860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3bd067440f4953920348efaafe66fa, user_id=f150cba7959d44aaa1f2fa1c45f3cee3, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:11.926495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 651/1280] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:11.926495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:11.926763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:11.934632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6fee8-7914-4659-a2bb-6a7339356485 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:11.940024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 630/1281] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:11 2022] PUT /identity/v3/projects/bd3bd067440f4953920348efaafe66fa/users/f150cba7959d44aaa1f2fa1c45f3cee3/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:11.941296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:12.006130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:12.007454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.007736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.008013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] PATH_INFO: `/v3/projects/17496a87829e4e6a8d4d33d2736ca5ea/users/532592384a174f4aade6ab3565fd32d3/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.012239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d640-26cc-4643-9f85-77f7f286e047 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:12.019821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:12.020847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.021127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.021393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] PATH_INFO: `/v3/projects/d9a24dde5805442391691aa4ea991203/users/337b71e5e2eb45ec89d94e12abe96c6c/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.023565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17496a87829e4e6a8d4d33d2736ca5ea, user_id=532592384a174f4aade6ab3565fd32d3, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:12.026480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:12.037907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a24dde5805442391691aa4ea991203, user_id=337b71e5e2eb45ec89d94e12abe96c6c, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:12.040707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:12.045224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 652/1282] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:11 2022] PUT /identity/v3/projects/17496a87829e4e6a8d4d33d2736ca5ea/users/532592384a174f4aade6ab3565fd32d3/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:12.046519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:12.056895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 631/1283] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:11 2022] PUT /identity/v3/projects/d9a24dde5805442391691aa4ea991203/users/337b71e5e2eb45ec89d94e12abe96c6c/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:12.059048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:12.093666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:12.113812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:12.132277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66033ea-6a64-437d-b945-de46c77ed167 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:12.144673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d891d4f-24e7-4f3c-95f1-177cd21e7cad admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:12.153618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51725c-4986-4114-8bae-7d78ad952339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:12.153618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51725c-4986-4114-8bae-7d78ad952339 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.153618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51725c-4986-4114-8bae-7d78ad952339 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.153618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51725c-4986-4114-8bae-7d78ad952339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.204779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:12.205654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.206602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.207051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] PATH_INFO: `/v3/projects/0f3e94c055ac4701ae2b1d0734ef086d/users/4ac6d0fcbeb7496db5bb873d99e1c20f/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.216334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51725c-4986-4114-8bae-7d78ad952339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:12.218211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51725c-4986-4114-8bae-7d78ad952339 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:12.225756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3e94c055ac4701ae2b1d0734ef086d, user_id=4ac6d0fcbeb7496db5bb873d99e1c20f, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:12.228922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:12.229844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 632/1284] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:12.238851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b178d1-4334-47cd-9251-928cd1d3b9af None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.238851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b178d1-4334-47cd-9251-928cd1d3b9af None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.238851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b178d1-4334-47cd-9251-928cd1d3b9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.261378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 653/1285] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:12 2022] PUT /identity/v3/projects/0f3e94c055ac4701ae2b1d0734ef086d/users/4ac6d0fcbeb7496db5bb873d99e1c20f/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:12.264156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:12.266136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e0b178d1-4334-47cd-9251-928cd1d3b9af None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:12.268363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e0b178d1-4334-47cd-9251-928cd1d3b9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:12.387544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 633/1286] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:12.393042 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08848-b079-4557-82eb-f2b1623edcfe None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.394704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad27ac-8297-4384-96d6-46962245f02f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:12.395064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08848-b079-4557-82eb-f2b1623edcfe None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.395583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08848-b079-4557-82eb-f2b1623edcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.406245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7a030-0326-46f1-ac95-c40ca1c3ffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:12.407075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a030-0326-46f1-ac95-c40ca1c3ffab admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.407874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a030-0326-46f1-ac95-c40ca1c3ffab admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.409495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a030-0326-46f1-ac95-c40ca1c3ffab admin admin] PATH_INFO: `/v3/projects/1397c4891c9e4fb8bdd4b93d866f3f74/users/555e66157a0745f3a41eb4908a0571f6/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.437916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7a030-0326-46f1-ac95-c40ca1c3ffab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1397c4891c9e4fb8bdd4b93d866f3f74, user_id=555e66157a0745f3a41eb4908a0571f6, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:12.440957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7a030-0326-46f1-ac95-c40ca1c3ffab admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:12.453090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9ed08848-b079-4557-82eb-f2b1623edcfe None None] MFA Rules not processed for user `f150cba7959d44aaa1f2fa1c45f3cee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:12.454476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9ed08848-b079-4557-82eb-f2b1623edcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:12.476466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 654/1287] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:12 2022] PUT /identity/v3/projects/1397c4891c9e4fb8bdd4b93d866f3f74/users/555e66157a0745f3a41eb4908a0571f6/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:12.476466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec7a9a-36c6-402f-adbe-fc00dccf94f3 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.476466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec7a9a-36c6-402f-adbe-fc00dccf94f3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.476466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec7a9a-36c6-402f-adbe-fc00dccf94f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.511773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-9cec7a9a-36c6-402f-adbe-fc00dccf94f3 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:12.513028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9cec7a9a-36c6-402f-adbe-fc00dccf94f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:12.591508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 634/1288] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:12.597187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6d43-9511-499c-917d-f8195605eb11 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.599702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6d43-9511-499c-917d-f8195605eb11 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.600514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6d43-9511-499c-917d-f8195605eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.600627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:12.629178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:12.634457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 655/1289] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:12.639388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.639674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.639945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.676401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-bffa6d43-9511-499c-917d-f8195605eb11 None None] MFA Rules not processed for user `337b71e5e2eb45ec89d94e12abe96c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:12.676656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:12.677758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bffa6d43-9511-499c-917d-f8195605eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:12.679010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:12.711923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 656/1290] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:12.712864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:12.714365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:12.818169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 635/1291] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:12.819653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a9df-662f-4dca-acdc-fd56793d10cc None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.820009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a9df-662f-4dca-acdc-fd56793d10cc None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.820390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a9df-662f-4dca-acdc-fd56793d10cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.832858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dcdc2-e37c-48a5-bc17-91c3f144d194 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:12.847825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:12.847825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.851130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.851424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.891689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-32e7a9df-662f-4dca-acdc-fd56793d10cc None None] MFA Rules not processed for user `555e66157a0745f3a41eb4908a0571f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:12.893010 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-32e7a9df-662f-4dca-acdc-fd56793d10cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:12.899408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:12.900873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:12.925138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 657/1292] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:12.926315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:12.946406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f463a-d095-48c2-999a-66d610cfcde9 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:12.965597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:12.966466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:12.967141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:12.967429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:12.969123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:12.976457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.071115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 658/1293] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:12 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:13.071115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.088289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 636/1294] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:13.089178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7a9df-662f-4dca-acdc-fd56793d10cc None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.111928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7a9df-662f-4dca-acdc-fd56793d10cc None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.164744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a666bdf-8531-41b8-87dc-637462c89a09 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.172497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.173015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.173340 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.173653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.209127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3a70-1a83-49ec-8cf5-83cbe018dd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.209758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3a70-1a83-49ec-8cf5-83cbe018dd6f service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.210071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3a70-1a83-49ec-8cf5-83cbe018dd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.210472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3a70-1a83-49ec-8cf5-83cbe018dd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.264973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:13.309239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3a70-1a83-49ec-8cf5-83cbe018dd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.313476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3a70-1a83-49ec-8cf5-83cbe018dd6f service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.315868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.317339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.335891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 659/1295] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:13.336758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.340773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 637/1296] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:13.342107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970d8c5-0b4a-48c2-8a6e-1277f34187a1 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.342579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970d8c5-0b4a-48c2-8a6e-1277f34187a1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.342887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970d8c5-0b4a-48c2-8a6e-1277f34187a1 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.345080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 638/1297] 10.222.0.16 () {54 vars in 961 bytes} [Tue Oct 11 13:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:13.345977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970d8c5-0b4a-48c2-8a6e-1277f34187a1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.355187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a1cfd-732d-484a-88f9-23bffe02c2a8 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.361369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.362199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.362624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.363072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.363796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.366561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.373353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:13.374664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970d8c5-0b4a-48c2-8a6e-1277f34187a1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.388281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f554f-0883-4a9f-8437-d841efb91481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.389140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f554f-0883-4a9f-8437-d841efb91481 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.389417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f554f-0883-4a9f-8437-d841efb91481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.391492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f554f-0883-4a9f-8437-d841efb91481 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.392162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f554f-0883-4a9f-8437-d841efb91481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.401004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f554f-0883-4a9f-8437-d841efb91481 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.418166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 660/1298] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:13 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:13.419341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.445080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 639/1299] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:13 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:13.448486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c232c-cb01-42bb-9d3f-a48e14010c1b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.449026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c232c-cb01-42bb-9d3f-a48e14010c1b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.449298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c232c-cb01-42bb-9d3f-a48e14010c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.494364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8e0c232c-cb01-42bb-9d3f-a48e14010c1b None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:13.495669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8e0c232c-cb01-42bb-9d3f-a48e14010c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:13.552878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f67e0a-7a62-481e-b03a-73a665f50e6e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.566486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.567724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.568015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.568667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.610851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 640/1300] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Oct 11 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:13.612136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c232c-cb01-42bb-9d3f-a48e14010c1b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.735710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.735710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.735710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 661/1301] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:13.735710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.753437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c232c-cb01-42bb-9d3f-a48e14010c1b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.762294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3cba0-2c2e-4974-976e-fb4ef5f85cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.764467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3cba0-2c2e-4974-976e-fb4ef5f85cff admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.765060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3cba0-2c2e-4974-976e-fb4ef5f85cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.765615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3cba0-2c2e-4974-976e-fb4ef5f85cff admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.766597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3cba0-2c2e-4974-976e-fb4ef5f85cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.769333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3cba0-2c2e-4974-976e-fb4ef5f85cff admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.837112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 641/1302] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:13 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:13.841729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca942f-dd0e-4480-ad36-40a5ec160fa2 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.843368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca942f-dd0e-4480-ad36-40a5ec160fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.843996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca942f-dd0e-4480-ad36-40a5ec160fa2 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.848605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 642/1303] 10.222.0.16 () {54 vars in 912 bytes} [Tue Oct 11 13:27:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:13.850887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca942f-dd0e-4480-ad36-40a5ec160fa2 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.882590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca942f-dd0e-4480-ad36-40a5ec160fa2 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.888372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eac521-6ce7-40f0-a0e4-5a69ed548f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.889240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac521-6ce7-40f0-a0e4-5a69ed548f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.889516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac521-6ce7-40f0-a0e4-5a69ed548f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.889835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac521-6ce7-40f0-a0e4-5a69ed548f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.890581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eac521-6ce7-40f0-a0e4-5a69ed548f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.893524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eac521-6ce7-40f0-a0e4-5a69ed548f48 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.906017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 643/1304] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:13.907317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43a0a-2f41-4822-8d73-911bc09371b4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.907644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43a0a-2f41-4822-8d73-911bc09371b4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.907916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43a0a-2f41-4822-8d73-911bc09371b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.910781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4b600-82c6-400a-85e5-6516d2a4bdc3 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.923770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.925928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.926548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.927224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:13.927912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:13.929567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:13.936391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-76b43a0a-2f41-4822-8d73-911bc09371b4 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:13.937983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-76b43a0a-2f41-4822-8d73-911bc09371b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:13.954895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 644/1305] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:13.956289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43a0a-2f41-4822-8d73-911bc09371b4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.970769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43a0a-2f41-4822-8d73-911bc09371b4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:13.973357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 662/1306] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:13.975569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:13.977078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:13.978427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:13.980232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:13.980780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] PATH_INFO: `/v3/projects/ebc32cd3221948d1949d529e4e486390/users/0224a18e7a9e49b6a77e23f7d7773e1a/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.000477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c738aa-c102-40d7-8c3f-b8240782c132 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:14.008209 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc32cd3221948d1949d529e4e486390, user_id=0224a18e7a9e49b6a77e23f7d7773e1a, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:14.011566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:14.013824 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:14.013975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.014615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.015470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.031993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:14.046086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:14.049334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:14.055874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 645/1307] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:13 2022] PUT /identity/v3/projects/ebc32cd3221948d1949d529e4e486390/users/0224a18e7a9e49b6a77e23f7d7773e1a/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:14.057433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:14.096605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 663/1308] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:14.098525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:14.130436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88e845-080c-404f-a73e-d4fcf58f2f76 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:14.144190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397732ec-374e-4afd-932b-84bd44134264 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:14.148879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:14.151751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.152049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.152327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.152732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:14.152996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:14.154058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.154611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.155187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] PATH_INFO: `/v3/projects/ec27c1c26a504490a5b6dc12bf15c9f0/users/bf9294bce7084b77b157e5a4fe206a2f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.161810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:14.178426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec27c1c26a504490a5b6dc12bf15c9f0, user_id=bf9294bce7084b77b157e5a4fe206a2f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:14.185113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:14.201438 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 664/1309] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:14.202909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:14.216908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 646/1310] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:14 2022] PUT /identity/v3/projects/ec27c1c26a504490a5b6dc12bf15c9f0/users/bf9294bce7084b77b157e5a4fe206a2f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:14.222877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:14.237874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edecae-00b4-473d-b77a-ac08f012d27d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:14.265950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:14.351345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181149-ae02-4380-890a-8a0e1a15b57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:14.352493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181149-ae02-4380-890a-8a0e1a15b57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.352965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181149-ae02-4380-890a-8a0e1a15b57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.353390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181149-ae02-4380-890a-8a0e1a15b57f admin admin] PATH_INFO: `/v3/projects/ebc32cd3221948d1949d529e4e486390/users/0224a18e7a9e49b6a77e23f7d7773e1a/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.355720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34181149-ae02-4380-890a-8a0e1a15b57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc32cd3221948d1949d529e4e486390, user_id=0224a18e7a9e49b6a77e23f7d7773e1a, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:14.359311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34181149-ae02-4380-890a-8a0e1a15b57f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:14.373493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 665/1311] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:14 2022] PUT /identity/v3/projects/ebc32cd3221948d1949d529e4e486390/users/0224a18e7a9e49b6a77e23f7d7773e1a/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:14.382742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f4af-5f8d-447e-aef7-243fa1deca9d None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.382742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f4af-5f8d-447e-aef7-243fa1deca9d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.382742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f4af-5f8d-447e-aef7-243fa1deca9d None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.383204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 666/1312] 10.222.0.16 () {54 vars in 912 bytes} [Tue Oct 11 13:27:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:14.384518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660bdf-a108-4c6f-bc35-5545065d38d8 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.384805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660bdf-a108-4c6f-bc35-5545065d38d8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.385079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660bdf-a108-4c6f-bc35-5545065d38d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.401283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08496-4d55-446c-afe7-4d92a69554cd admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:14.425722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d7660bdf-a108-4c6f-bc35-5545065d38d8 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:14.430051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d7660bdf-a108-4c6f-bc35-5545065d38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:14.544714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:14.545800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.546079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.546350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.548345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:14.550017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:14.584121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 667/1313] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:27:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:14.585954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933d75a-f400-4989-a0a4-1db20abe0eec None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.586555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933d75a-f400-4989-a0a4-1db20abe0eec None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.587097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933d75a-f400-4989-a0a4-1db20abe0eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.587496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 647/1314] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:14.595886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:14.623746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfb4a2-9abb-416c-baf3-5e884e9750f6 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:14.633568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:14.634181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.634748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.635064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] PATH_INFO: `/v3/projects/ec27c1c26a504490a5b6dc12bf15c9f0/users/bf9294bce7084b77b157e5a4fe206a2f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.642140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec27c1c26a504490a5b6dc12bf15c9f0, user_id=bf9294bce7084b77b157e5a4fe206a2f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:14.648005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:14.655092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1933d75a-f400-4989-a0a4-1db20abe0eec None None] MFA Rules not processed for user `0224a18e7a9e49b6a77e23f7d7773e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:14.656549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1933d75a-f400-4989-a0a4-1db20abe0eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:14.695423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 648/1315] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:14 2022] PUT /identity/v3/projects/ec27c1c26a504490a5b6dc12bf15c9f0/users/bf9294bce7084b77b157e5a4fe206a2f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:14.695423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:14.744329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:14.867686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a3486-ec63-453a-ae0c-c74bc464b97c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:14.881516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:14.882911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 668/1316] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:14.885677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f483-8bb7-404e-bea5-36efe7ae835e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.887099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f483-8bb7-404e-bea5-36efe7ae835e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.887863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f483-8bb7-404e-bea5-36efe7ae835e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.888010 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:14.888202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:14.889063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:14.956002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ed53f483-8bb7-404e-bea5-36efe7ae835e None None] MFA Rules not processed for user `bf9294bce7084b77b157e5a4fe206a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:14.957328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ed53f483-8bb7-404e-bea5-36efe7ae835e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:14.986005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:15.080830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:15.082303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:15.109531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 649/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:15.111200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:15.116732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 669/1318] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:15.150357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ffad0-c4f5-4184-80e7-5ea30844cb5b service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:15.160861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:15.164587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:15.165759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:15.166264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:15.198408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f483-8bb7-404e-bea5-36efe7ae835e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:15.215503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f483-8bb7-404e-bea5-36efe7ae835e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:15.233787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:15.234578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:15.234751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:15.235170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:15.257312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:15.258680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:15.288548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 670/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:15.478946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:15.512536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:15.519257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:15.556172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 650/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:15.628933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3bc19-4f8e-4ce6-8c04-2f053bcfca89 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:15.633185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:15.643699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:15.644565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:15.644946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:15.645232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a7c8-6ce1-446c-9d4f-70f119f96f56 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:15.645418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] PATH_INFO: `/v3/users/2bc6ddeabddc438f8205b9125f9357a9` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:15.647787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc6ddeabddc438f8205b9125f9357a9)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:15.652379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:15.656419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99597a-7698-4eea-9c55-11f26a6d9342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:15.657127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99597a-7698-4eea-9c55-11f26a6d9342 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:15.657400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99597a-7698-4eea-9c55-11f26a6d9342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:15.657713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99597a-7698-4eea-9c55-11f26a6d9342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:15.766031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:15.793551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc6ddeabddc438f8205b9125f9357a9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:15.795863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99597a-7698-4eea-9c55-11f26a6d9342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:15.796868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99597a-7698-4eea-9c55-11f26a6d9342 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:15.807255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc6ddeabddc438f8205b9125f9357a9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:15.808555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc6ddeabddc438f8205b9125f9357a9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:15.811095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc6ddeabddc438f8205b9125f9357a9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:15.826555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc6ddeabddc438f8205b9125f9357a9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:15.828187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 651/1321] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:27:15.900323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 671/1322] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:15 2022] DELETE /identity/v3/users/2bc6ddeabddc438f8205b9125f9357a9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:15.900587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:15.900587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:15.900587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:15.950790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:15.954083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:16.122215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 652/1323] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:16.194594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:16.196764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:16.273008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:16.424500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5657-f73d-4bba-97ff-0b71d3aaf447 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:16.445005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ecaf7-1dcc-4647-afe5-bb838a7c1ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:16.445998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ecaf7-1dcc-4647-afe5-bb838a7c1ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:16.446961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ecaf7-1dcc-4647-afe5-bb838a7c1ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:16.446961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ecaf7-1dcc-4647-afe5-bb838a7c1ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:16.521145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ecaf7-1dcc-4647-afe5-bb838a7c1ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:16.529221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ecaf7-1dcc-4647-afe5-bb838a7c1ee2 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:16.594735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 672/1324] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:17.270532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:17.272332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:17.288755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b18f9-91d8-4308-89be-2bbf037a0905 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:17.298808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:17.300015 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:17.300378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:17.301197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] PATH_INFO: `/v3/users/337b71e5e2eb45ec89d94e12abe96c6c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:17.303591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337b71e5e2eb45ec89d94e12abe96c6c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:17.309363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: WARNING py.warnings [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:27:17.309363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: warnings.warn(msg) Oct 11 13:27:17.309363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: Oct 11 13:27:17.314094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:17.450575 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337b71e5e2eb45ec89d94e12abe96c6c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:17.469991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337b71e5e2eb45ec89d94e12abe96c6c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:17.471174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337b71e5e2eb45ec89d94e12abe96c6c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:17.472475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337b71e5e2eb45ec89d94e12abe96c6c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:17.490631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337b71e5e2eb45ec89d94e12abe96c6c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:17.537277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 653/1325] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:17 2022] DELETE /identity/v3/users/337b71e5e2eb45ec89d94e12abe96c6c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:17.544116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:17.547777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:17.548505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:17.591953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:17.596098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:17.743317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 673/1326] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:17.759904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:17.761793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:17.872429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:17.874324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:17.893641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6946bb9-bd10-4704-9d92-8aa043f0352e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:17.909114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:17.910017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:17.910466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:17.910919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] PATH_INFO: `/v3/projects/a449b4373e3f4fffa42e08409da763ba` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:17.913506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a449b4373e3f4fffa42e08409da763ba)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:17.915087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: WARNING py.warnings [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 13:27:17.915087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: warnings.warn(msg) Oct 11 13:27:17.915087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: Oct 11 13:27:17.916791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:18.011420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9ae4f-bbba-46e0-afe2-8f9f767a00b5 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:18.047321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:18.057884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a449b4373e3f4fffa42e08409da763ba', 'request_id': 'req-258981bd-1ff5-4847-99fc-4522d8e1bedc'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:18.079254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a449b4373e3f4fffa42e08409da763ba', 'request_id': 'req-258981bd-1ff5-4847-99fc-4522d8e1bedc'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:18.103937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a449b4373e3f4fffa42e08409da763ba', 'request_id': 'req-258981bd-1ff5-4847-99fc-4522d8e1bedc'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:18.172521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] The token cache is being invalidate because project a449b4373e3f4fffa42e08409da763ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:18.173794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:18.176181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-258981bd-1ff5-4847-99fc-4522d8e1bedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:18.180013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 674/1327] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:17 2022] DELETE /identity/v3/projects/a449b4373e3f4fffa42e08409da763ba => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:18.184854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f74a6-8b8c-4b27-9c3c-d9c7c7409548 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:18.185236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:18.185592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f74a6-8b8c-4b27-9c3c-d9c7c7409548 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:18.186015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f74a6-8b8c-4b27-9c3c-d9c7c7409548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:18.187468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:18.187748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:18.188017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:18.209039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:18.237396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-0b5f74a6-8b8c-4b27-9c3c-d9c7c7409548 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:18.240453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0b5f74a6-8b8c-4b27-9c3c-d9c7c7409548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:18.357474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:18.434882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 675/1328] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:18.447193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219218-0996-42a0-83aa-9c2984d6d214 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:18.447522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219218-0996-42a0-83aa-9c2984d6d214 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:18.451007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219218-0996-42a0-83aa-9c2984d6d214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:18.517559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:18.529641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:18.556036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-92219218-0996-42a0-83aa-9c2984d6d214 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:18.557923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-92219218-0996-42a0-83aa-9c2984d6d214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:18.568360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 654/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:18.580089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 676/1330] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:18.581282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:18.613368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951ae84-6541-452c-934f-2647a405ac64 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:18.654245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:18.654978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:18.655259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:18.660751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:18.666520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:18.667363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:18.669142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:18.687635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 655/1331] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:18.688165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219218-0996-42a0-83aa-9c2984d6d214 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:18.705741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219218-0996-42a0-83aa-9c2984d6d214 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:18.710572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:18.711322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:18.711599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:18.711867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:18.712531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:18.714490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:18.780622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 677/1332] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:18 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:18.782790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:18.797738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6319-25c9-4068-86b2-6f5f36eb9faf admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:18.952706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:18.953632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:18.954121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:18.954633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:18.956283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:18.958699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:19.014370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 656/1333] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:18 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:19.015469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:19.033292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fba06-0a44-46cd-961a-873df845b7a9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:19.052286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:19.052929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:19.053207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:19.053533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:19.054116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:19.055788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:19.076321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 678/1334] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:19.079493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:19.094232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbea58-18ec-46aa-85c7-16d2dd9346bf admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:19.106014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485c91-bd74-4223-a8e5-bee3e7c21985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:19.107809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485c91-bd74-4223-a8e5-bee3e7c21985 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:19.108743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485c91-bd74-4223-a8e5-bee3e7c21985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:19.109235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485c91-bd74-4223-a8e5-bee3e7c21985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:19.110291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485c91-bd74-4223-a8e5-bee3e7c21985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:19.113956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485c91-bd74-4223-a8e5-bee3e7c21985 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:19.161620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 657/1335] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:19.162151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:19.181531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b780-13b8-4f19-807b-bc503b688ea0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:19.198005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:19.198707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:19.199012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:19.199288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] PATH_INFO: `/v3/projects/350cb408a7464aaf837a0b8654b49cef/users/9f7a87e345124760bb154bbd8ad69392/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:19.223551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350cb408a7464aaf837a0b8654b49cef, user_id=9f7a87e345124760bb154bbd8ad69392, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:19.226333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:19.255134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 679/1336] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:19 2022] PUT /identity/v3/projects/350cb408a7464aaf837a0b8654b49cef/users/9f7a87e345124760bb154bbd8ad69392/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:19.259461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c83a2-0199-4c93-9f1b-a56e98c223f3 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:19.260645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c83a2-0199-4c93-9f1b-a56e98c223f3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:19.260645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c83a2-0199-4c93-9f1b-a56e98c223f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:19.311234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e34c83a2-0199-4c93-9f1b-a56e98c223f3 None None] MFA Rules not processed for user `9f7a87e345124760bb154bbd8ad69392`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:19.315549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e34c83a2-0199-4c93-9f1b-a56e98c223f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:19.355706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:19.557028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 658/1337] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:19.561284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:19.832365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e78fbb-9acf-4be0-8fea-c3f2d45956e5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:19.868088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:19.868835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:19.869122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:19.869404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:19.881474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:19.883563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:19.957529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 680/1338] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:19 2022] POST /identity/v3/projects => generated 383 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:19.961934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c83a2-0199-4c93-9f1b-a56e98c223f3 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:19.981896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c83a2-0199-4c93-9f1b-a56e98c223f3 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:20.119057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:20.120873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:20.233404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:20.235875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.236613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.237262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:20.240699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:20.247852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:20.313906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 659/1339] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:19 2022] POST /identity/v3/users => generated 298 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:20.315642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:20.316192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140464f8-6b53-43c7-ac58-b11b80faa68f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:20.345584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bb1c3-9df7-4a10-aa72-1fda6cfde652 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:20.345812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:20.346599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.347046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.347326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] PATH_INFO: `/v3/projects/d9a24dde5805442391691aa4ea991203` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:20.349680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a24dde5805442391691aa4ea991203)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:20.352647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:20.356424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:20.359842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.363335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.363950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:20.365060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:20.372326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:20.372556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:20.400240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 660/1340] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:20.404609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:20.430586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c7d9f-b0cc-4279-a558-b98e90789ff3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:20.463865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:20.464833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.465209 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.465565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] PATH_INFO: `/v3/projects/a46aecbf536340a2a131b5963eaa2e89/users/236ebef0a61f450cbc72608eeec2673a/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:20.520391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a24dde5805442391691aa4ea991203', 'request_id': 'req-b1caff5c-62df-426d-bc97-0c340c58a99b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:20.534494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a24dde5805442391691aa4ea991203', 'request_id': 'req-b1caff5c-62df-426d-bc97-0c340c58a99b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:20.536621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46aecbf536340a2a131b5963eaa2e89, user_id=236ebef0a61f450cbc72608eeec2673a, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:20.545522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:20.550192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a24dde5805442391691aa4ea991203', 'request_id': 'req-b1caff5c-62df-426d-bc97-0c340c58a99b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:20.574954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] The token cache is being invalidate because project d9a24dde5805442391691aa4ea991203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:20.575567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:20.577293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 661/1341] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:20 2022] PUT /identity/v3/projects/a46aecbf536340a2a131b5963eaa2e89/users/236ebef0a61f450cbc72608eeec2673a/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:20.578006 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:20.581871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 681/1342] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:20 2022] DELETE /identity/v3/projects/d9a24dde5805442391691aa4ea991203 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:20.587594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:20.588088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:20.591878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:20.597868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:20.779218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caff5c-62df-426d-bc97-0c340c58a99b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:20.802947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684578-a986-47ba-9944-c4d610ddff3e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:20.811323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:20.812260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.812542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.815092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:20.815578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:20.817246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:20.849586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 662/1343] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:20.854736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:20.877862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405eb0-988e-40e6-ac99-cead775b7f37 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:20.902484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:20.903313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.903593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.903999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] PATH_INFO: `/v3/users/0224a18e7a9e49b6a77e23f7d7773e1a` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:20.905247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0224a18e7a9e49b6a77e23f7d7773e1a)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:20.905382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75b30-6916-45b4-a495-69b334eb501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:20.906187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75b30-6916-45b4-a495-69b334eb501d admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.906471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75b30-6916-45b4-a495-69b334eb501d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.906989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75b30-6916-45b4-a495-69b334eb501d admin admin] PATH_INFO: `/v3/projects/a46aecbf536340a2a131b5963eaa2e89/users/236ebef0a61f450cbc72608eeec2673a/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:20.907758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:20.915682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75b30-6916-45b4-a495-69b334eb501d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46aecbf536340a2a131b5963eaa2e89, user_id=236ebef0a61f450cbc72608eeec2673a, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:20.920136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75b30-6916-45b4-a495-69b334eb501d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:20.926976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:20.964337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 663/1344] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:20 2022] PUT /identity/v3/projects/a46aecbf536340a2a131b5963eaa2e89/users/236ebef0a61f450cbc72608eeec2673a/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:20.975217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:20.975826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:20.976373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:21.011839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:21.017396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0224a18e7a9e49b6a77e23f7d7773e1a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:21.034472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0224a18e7a9e49b6a77e23f7d7773e1a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:21.036990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0224a18e7a9e49b6a77e23f7d7773e1a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:21.037886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0224a18e7a9e49b6a77e23f7d7773e1a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:21.073179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] MFA Rules not processed for user `236ebef0a61f450cbc72608eeec2673a`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:21.073548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0224a18e7a9e49b6a77e23f7d7773e1a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:21.074942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:21.149303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 682/1345] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:20 2022] DELETE /identity/v3/users/0224a18e7a9e49b6a77e23f7d7773e1a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:21.277864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 664/1346] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:21.290695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:21.292890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:21.509761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e25bb-cf75-4170-b065-38c2e20ef683 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:21.528116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9d43f-1eb8-42b6-ab89-637dbfbaabc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:21.529182 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d43f-1eb8-42b6-ab89-637dbfbaabc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:21.530842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d43f-1eb8-42b6-ab89-637dbfbaabc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:21.531058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d43f-1eb8-42b6-ab89-637dbfbaabc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:21.778406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9d43f-1eb8-42b6-ab89-637dbfbaabc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:21.785850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9d43f-1eb8-42b6-ab89-637dbfbaabc0 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:21.824180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 683/1347] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:21.859288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:21.862608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:22.100669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a6896-84df-4621-81cb-0f945e0f46a8 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:22.366876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:22.368635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:22.369061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:22.372013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] PATH_INFO: `/v3/users/9f7a87e345124760bb154bbd8ad69392` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:22.374326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7a87e345124760bb154bbd8ad69392)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:22.384304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:22.508697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:22.533156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7a87e345124760bb154bbd8ad69392'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:22.557815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7a87e345124760bb154bbd8ad69392'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:22.558592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7a87e345124760bb154bbd8ad69392'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:22.559869 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7a87e345124760bb154bbd8ad69392'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:22.572371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4a012e00-8d59-4ab1-a606-c00163bd84f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7a87e345124760bb154bbd8ad69392'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:22.626614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 665/1348] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:21 2022] DELETE /identity/v3/users/9f7a87e345124760bb154bbd8ad69392 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:22.628758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:22.629363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:22.629715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:22.682478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697605e-de4b-4385-adef-211da4c5e49d None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:22.682767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697605e-de4b-4385-adef-211da4c5e49d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:22.683066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697605e-de4b-4385-adef-211da4c5e49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:22.685276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:22.687911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:22.744555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-7697605e-de4b-4385-adef-211da4c5e49d None None] MFA Rules not processed for user `e1087a14fa6343c680c16d9456d96ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:22.745807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7697605e-de4b-4385-adef-211da4c5e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:22.829982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 684/1349] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:22.850805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:22.857564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:22.902623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:22.913283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 666/1350] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:22.932604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:22.933515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:22.934275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:22.989854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] MFA Rules not processed for user `e1087a14fa6343c680c16d9456d96ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:22.994304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:23.012738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 667/1351] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:23.014381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:23.017714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:23.052234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe49d-7313-4883-956f-3d56725640d2 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:23.053272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f30de6-ad8d-46ab-a9ca-453e7d484254 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:23.056563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:23.057292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.057690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.058073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.061320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:23.062160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.062702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.063279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] PATH_INFO: `/v3/projects/ebc32cd3221948d1949d529e4e486390` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.073219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:23.074791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:23.077476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc32cd3221948d1949d529e4e486390)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:23.086703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:23.099656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 685/1352] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:23.101651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:23.105238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:23.216898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc32cd3221948d1949d529e4e486390', 'request_id': 'req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:23.232955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc32cd3221948d1949d529e4e486390', 'request_id': 'req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:23.244260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc32cd3221948d1949d529e4e486390', 'request_id': 'req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:23.273582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] The token cache is being invalidate because project ebc32cd3221948d1949d529e4e486390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:23.273934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:23.282578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5dd7fac6-cc80-4ac5-b3d7-59e681756d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:23.288467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 668/1353] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:23 2022] DELETE /identity/v3/projects/ebc32cd3221948d1949d529e4e486390 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:23.290164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353a9b-854a-44c7-a874-7e91176ce4a5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.290452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353a9b-854a-44c7-a874-7e91176ce4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.290908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353a9b-854a-44c7-a874-7e91176ce4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.348167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-22353a9b-854a-44c7-a874-7e91176ce4a5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:23.349449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-22353a9b-854a-44c7-a874-7e91176ce4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:23.375675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:23.459469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d6a97-cf80-413e-8f7d-86848b6190d8 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:23.497798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 669/1354] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:23.506190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bdd0f-740a-482d-ade8-bbc164778d8f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.506577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bdd0f-740a-482d-ade8-bbc164778d8f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.506887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bdd0f-740a-482d-ade8-bbc164778d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.546584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-261bdd0f-740a-482d-ade8-bbc164778d8f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:23.547793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-261bdd0f-740a-482d-ade8-bbc164778d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:23.562603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 670/1355] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:23.567607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bdd0f-740a-482d-ade8-bbc164778d8f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:23.582354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bdd0f-740a-482d-ade8-bbc164778d8f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:23.595716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:23.598162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.598971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.599669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.601422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:23.604182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:23.609714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:23.632632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:23.633869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.637574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.639545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.642299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 671/1356] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:23.646964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:23.648049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:23.676786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82405c-4ee7-47b9-9fa6-26879ff0482a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:23.692160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:23.693116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.694014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.695066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.696516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:23.698727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:23.743290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:23.757522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:23.760773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:23.777727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 672/1357] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:23 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:23.778771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:23.781220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:23.799405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 686/1358] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:23.801494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:23.843584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667cf1-8644-4b6f-bf94-73f82707c414 service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:23.882729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a8f2-8b6e-4c1c-a70e-27ece30ae6bb admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:23.891532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:23.892466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.892804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.893102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] PATH_INFO: `/v3/projects/350cb408a7464aaf837a0b8654b49cef` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.895663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350cb408a7464aaf837a0b8654b49cef)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:23.898659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:23.971301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350cb408a7464aaf837a0b8654b49cef', 'request_id': 'req-dd257a3d-417e-44d5-a62e-7e7afc05def8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:23.975160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:23.976040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:23.976581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:23.977444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:23.978420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:23.982018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:23.983097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350cb408a7464aaf837a0b8654b49cef', 'request_id': 'req-dd257a3d-417e-44d5-a62e-7e7afc05def8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:23.994031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350cb408a7464aaf837a0b8654b49cef', 'request_id': 'req-dd257a3d-417e-44d5-a62e-7e7afc05def8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.012303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] The token cache is being invalidate because project 350cb408a7464aaf837a0b8654b49cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:24.012607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.014582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.017041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 673/1359] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:23 2022] DELETE /identity/v3/projects/350cb408a7464aaf837a0b8654b49cef => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:24.027358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 687/1360] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:23 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:24.027510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:24.029005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:24.030897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:24.033074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:24.035419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:24.059096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a452ea-a1e8-416b-ab60-a89700a99633 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:24.203180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:24.204116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.205231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.205739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.206878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:24.209096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:24.227692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 688/1361] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:27:24.232553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:24.233266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257a3d-417e-44d5-a62e-7e7afc05def8 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:24.238997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:24.239524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.239799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.240069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] PATH_INFO: `/v3/users/236ebef0a61f450cbc72608eeec2673a` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.241221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] RBAC: Authorizing `identity:delete_user(user_id=236ebef0a61f450cbc72608eeec2673a)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:24.243205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:24.297441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de9bbf-66a0-4e4e-af4a-ba4166ce5667 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:24.322911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:24.323549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.323823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.324098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.324740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:24.326356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:24.348229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236ebef0a61f450cbc72608eeec2673a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.368070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236ebef0a61f450cbc72608eeec2673a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.368827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236ebef0a61f450cbc72608eeec2673a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.369439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236ebef0a61f450cbc72608eeec2673a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.371483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 689/1362] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:24.372418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:24.384837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:24.390216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2da0136d-d2f9-4773-9fe3-9ea62e53490e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236ebef0a61f450cbc72608eeec2673a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:24.416732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ef14-a15d-4767-a65b-a3f14be407aa admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:24.438741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8191b9-f3c0-40e8-96ac-eb99072a82dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:24.439448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8191b9-f3c0-40e8-96ac-eb99072a82dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.439720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8191b9-f3c0-40e8-96ac-eb99072a82dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.439987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8191b9-f3c0-40e8-96ac-eb99072a82dd admin admin] PATH_INFO: `/v3/projects/a7cf6dd4abb74c74a9b0cd9bcfdcf9a3/users/58aa4552173645cbaf97f8ce92767663/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.444642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 674/1363] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:24 2022] DELETE /identity/v3/users/236ebef0a61f450cbc72608eeec2673a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:24.477086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8191b9-f3c0-40e8-96ac-eb99072a82dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7cf6dd4abb74c74a9b0cd9bcfdcf9a3, user_id=58aa4552173645cbaf97f8ce92767663, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:24.479795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8191b9-f3c0-40e8-96ac-eb99072a82dd admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:24.513325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 690/1364] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:24 2022] PUT /identity/v3/projects/a7cf6dd4abb74c74a9b0cd9bcfdcf9a3/users/58aa4552173645cbaf97f8ce92767663/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:24.515387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.515679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.517047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.538461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b59e5-7719-49fd-9770-d070ce791dc2 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.538744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b59e5-7719-49fd-9770-d070ce791dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.539637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b59e5-7719-49fd-9770-d070ce791dc2 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.541587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 691/1365] 10.222.0.16 () {54 vars in 912 bytes} [Tue Oct 11 13:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:24.550682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4344a-a117-4edd-960f-aa780077b6e5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.550906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4344a-a117-4edd-960f-aa780077b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.551161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4344a-a117-4edd-960f-aa780077b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.614499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] MFA Rules not processed for user `58aa4552173645cbaf97f8ce92767663`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:24.622887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:24.693833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6ef4344a-a117-4edd-960f-aa780077b6e5 None None] MFA Rules not processed for user `ed8635b4ce034605bcce301f3f98e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:24.696548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6ef4344a-a117-4edd-960f-aa780077b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:24.760505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:24.832043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 692/1366] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:27:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:24.832519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 675/1367] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:24.836995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4344a-a117-4edd-960f-aa780077b6e5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:24.867688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:24.870260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:24.894648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a2946-7bd0-4387-8209-7d7cde7e1bb5 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:24.902983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:24.904608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:24.905114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:24.906873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:24.923457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:24.930959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:24.949562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:24.975775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 676/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:27:25.018159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4344a-a117-4edd-960f-aa780077b6e5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.026327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.026946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.027346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.027648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.028495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.031438 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.094064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 693/1369] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:24 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:25.097395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.122301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad61b8-3aea-4392-a8c8-02d257e132d5 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.277287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.278544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.278839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.280435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.282758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.288786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.331399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 677/1370] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:25 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:25.336249 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.384689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c9e4-41a0-4b72-ad96-2bd909a87d74 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.390709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.392406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.394289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.394801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.396067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:25.406865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.407987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.411796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.415957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc7f05-cfc9-4ad3-b6bf-a3bfc2db7506 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.427641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.429362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.429791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.430076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] PATH_INFO: `/v3/projects/a46aecbf536340a2a131b5963eaa2e89` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.433847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46aecbf536340a2a131b5963eaa2e89)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.434868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 694/1371] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:27:25.436046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.439463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.451236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3548-c3c5-43b5-bb1b-bfc31d456131 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.458949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.460835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.461710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.462204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] PATH_INFO: `/v3/projects/ab0fedecdee741bc8d11d86d71f7e8d7/users/c3970396f9724d2da0372fee19544a21/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.487219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fedecdee741bc8d11d86d71f7e8d7, user_id=c3970396f9724d2da0372fee19544a21, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.491001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.513347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 695/1372] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:25 2022] PUT /identity/v3/projects/ab0fedecdee741bc8d11d86d71f7e8d7/users/c3970396f9724d2da0372fee19544a21/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:25.514416 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.527605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46aecbf536340a2a131b5963eaa2e89', 'request_id': 'req-f7f989cc-d066-456f-9217-fbb43a72316a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:25.544130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46aecbf536340a2a131b5963eaa2e89', 'request_id': 'req-f7f989cc-d066-456f-9217-fbb43a72316a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:25.555599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46aecbf536340a2a131b5963eaa2e89', 'request_id': 'req-f7f989cc-d066-456f-9217-fbb43a72316a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:25.569570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] The token cache is being invalidate because project a46aecbf536340a2a131b5963eaa2e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:25.569570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:25.571112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f7f989cc-d066-456f-9217-fbb43a72316a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:25.573510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 678/1373] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:25 2022] DELETE /identity/v3/projects/a46aecbf536340a2a131b5963eaa2e89 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:25.580511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef906-35bb-4768-a8ed-03a56a0cb687 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.582125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef906-35bb-4768-a8ed-03a56a0cb687 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.582577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef906-35bb-4768-a8ed-03a56a0cb687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.616793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fccef906-35bb-4768-a8ed-03a56a0cb687 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:25.618835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fccef906-35bb-4768-a8ed-03a56a0cb687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:25.620573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c452b-5999-4ddd-a862-ad35ac2def33 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.625642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.626335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.626616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.626926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.627812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.629920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.631762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 679/1374] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:25.640498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9562-d662-49e0-a04d-decf33d32209 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.641281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9562-d662-49e0-a04d-decf33d32209 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.641866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9562-d662-49e0-a04d-decf33d32209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.666602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 696/1375] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:25.671067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-dbfa9562-d662-49e0-a04d-decf33d32209 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:25.671577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.672810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-dbfa9562-d662-49e0-a04d-decf33d32209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:25.674529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:25.694155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 680/1376] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:25.698132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa9562-d662-49e0-a04d-decf33d32209 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.722348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464ad69-44d6-4360-8727-fede05f6ec6a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.723806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa9562-d662-49e0-a04d-decf33d32209 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.738257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.739110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446b77-fd9a-4746-a483-5ddde121002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.740265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.741076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446b77-fd9a-4746-a483-5ddde121002c admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.741220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.741392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.742285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446b77-fd9a-4746-a483-5ddde121002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.742560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446b77-fd9a-4746-a483-5ddde121002c admin admin] PATH_INFO: `/v3/projects/ab0fedecdee741bc8d11d86d71f7e8d7/users/c3970396f9724d2da0372fee19544a21/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.744296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:25.745183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.749562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.750081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446b77-fd9a-4746-a483-5ddde121002c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fedecdee741bc8d11d86d71f7e8d7, user_id=c3970396f9724d2da0372fee19544a21, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.756800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446b77-fd9a-4746-a483-5ddde121002c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:25.795454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 681/1377] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:25.795640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 697/1378] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:25 2022] PUT /identity/v3/projects/ab0fedecdee741bc8d11d86d71f7e8d7/users/c3970396f9724d2da0372fee19544a21/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:25.796917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:25.816485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.818493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.819661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.831830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b172a0f-d4bd-4736-b797-8f3759e2a810 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:25.888243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:25.925561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:25.933641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] MFA Rules not processed for user `c3970396f9724d2da0372fee19544a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:25.940424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:25.957121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:25.957946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:25.958341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:25.958678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:25.959412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:25.961545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.026683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 682/1379] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:25 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:26.028267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:26.181793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 698/1380] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:26.203799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:26.206500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:26.255055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2faf9-4416-437c-b2a3-d6f6660d6095 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:26.267189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:26.267889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:26.268816 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:26.269296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:26.269976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:26.274573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.320765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 683/1381] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:26 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:26.322442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:26.330457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:26.425896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b4ae8-7b5e-401c-be41-afbd7bd4d55b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:26.558458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f24d0-31b1-4c8f-9571-bc0f20edb934 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:26.563178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:26.563822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:26.565911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:26.566392 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:26.570768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:26.573960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:26.579785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:26.579917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:26.580466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:26.593550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:26.609919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:26.619204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.663503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 699/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:26.664513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:26.698161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81b06-4b0a-4a55-bf5a-e25ca9090bc2 service placement] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:26.713741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:26.714385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:26.714666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:26.714971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:26.717755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:26.720141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.722604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:26.724371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.746461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 700/1383] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:26.747377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:26.752556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:26.760622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 684/1384] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:26.762715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:26.787643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a83fd8-f44e-4adb-8f67-6b84e9fa0e24 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:26.787901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a91b5-8360-4193-b995-9020d8a5e5fd service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:26.799190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:26.802173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:26.802881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:26.802994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:26.803178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:26.803381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:26.803464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] PATH_INFO: `/v3/users/f150cba7959d44aaa1f2fa1c45f3cee3` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:26.803725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:26.807474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:26.809349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.809482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f150cba7959d44aaa1f2fa1c45f3cee3)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:26.818534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.850421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 685/1385] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:26.855295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:26.866333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:26.874182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:26.891823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a5baf-558d-4dfd-94ac-e5cfd8250d94 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:26.927239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302ae45-c899-4f73-add0-ea7656ebbc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:26.928023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302ae45-c899-4f73-add0-ea7656ebbc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:26.928306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302ae45-c899-4f73-add0-ea7656ebbc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:26.929224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302ae45-c899-4f73-add0-ea7656ebbc4c admin admin] PATH_INFO: `/v3/projects/84838a753b1d4eb88988aca6ab179a7b/users/979ed4833c4b4a41b786bd3040736819/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:26.960109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f150cba7959d44aaa1f2fa1c45f3cee3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:26.977904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f150cba7959d44aaa1f2fa1c45f3cee3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:26.978835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f150cba7959d44aaa1f2fa1c45f3cee3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:26.979764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f150cba7959d44aaa1f2fa1c45f3cee3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:26.979906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302ae45-c899-4f73-add0-ea7656ebbc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84838a753b1d4eb88988aca6ab179a7b, user_id=979ed4833c4b4a41b786bd3040736819, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:26.988597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302ae45-c899-4f73-add0-ea7656ebbc4c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:26.996404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e4c62574-8c94-4a6d-9445-c4e9fca63d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f150cba7959d44aaa1f2fa1c45f3cee3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:27.021484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 686/1386] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:26 2022] PUT /identity/v3/projects/84838a753b1d4eb88988aca6ab179a7b/users/979ed4833c4b4a41b786bd3040736819/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:27.033329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:27.034097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:27.034359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:27.061466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 701/1387] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:26 2022] DELETE /identity/v3/users/f150cba7959d44aaa1f2fa1c45f3cee3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:27.063640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:27.063926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:27.064196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:27.105379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] MFA Rules not processed for user `979ed4833c4b4a41b786bd3040736819`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:27.108863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:27.153307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:27.154531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:27.307858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 702/1388] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:27.309527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:27.339175 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:27.393671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd920d94-efd5-4381-ad4e-accb8c481fbd None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:27.404846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 687/1389] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:27.406450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:27.408556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:27.410552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:27.414252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:27.415307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:27.415794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] PATH_INFO: `/v3/users/555e66157a0745f3a41eb4908a0571f6` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:27.418866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=555e66157a0745f3a41eb4908a0571f6)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:27.425623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:27.590305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555e66157a0745f3a41eb4908a0571f6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:27.605830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555e66157a0745f3a41eb4908a0571f6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:27.621931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555e66157a0745f3a41eb4908a0571f6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:27.623560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555e66157a0745f3a41eb4908a0571f6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:27.627106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d7d20-6a1f-41fa-b893-1dde4b308699 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:27.640366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555e66157a0745f3a41eb4908a0571f6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:27.642781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11370f-85ce-4ca5-b789-4a0d61731637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:27.644242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11370f-85ce-4ca5-b789-4a0d61731637 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:27.644937 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11370f-85ce-4ca5-b789-4a0d61731637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:27.645212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11370f-85ce-4ca5-b789-4a0d61731637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:27.653170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fb11370f-85ce-4ca5-b789-4a0d61731637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:27.671163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11370f-85ce-4ca5-b789-4a0d61731637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:27.673097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11370f-85ce-4ca5-b789-4a0d61731637 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:27.688836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 703/1390] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:27 2022] DELETE /identity/v3/users/555e66157a0745f3a41eb4908a0571f6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:27.689966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:27.691523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:27.694095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 688/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:27.698710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34af64-7afd-4806-b5d7-54fee14d85c8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:27.699128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34af64-7afd-4806-b5d7-54fee14d85c8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:27.699407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34af64-7afd-4806-b5d7-54fee14d85c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:27.700579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:27.773219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4f34af64-7afd-4806-b5d7-54fee14d85c8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:27.776373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4f34af64-7afd-4806-b5d7-54fee14d85c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:27.935304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70312f-9e33-47f3-ba81-ab4a29d131cd admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:27.954971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:27.958217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:27.959269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:27.962464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:27.964828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:27.974316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:27.981014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 689/1392] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:28.120324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 704/1393] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:27 2022] POST /identity/v3/projects => generated 381 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:28.121610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34af64-7afd-4806-b5d7-54fee14d85c8 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:28.140740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34af64-7afd-4806-b5d7-54fee14d85c8 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:28.163764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:28.314009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:28.314657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:28.314962 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:28.315408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:28.316356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:28.318347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:28.365945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 690/1394] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:28 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:28.370456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:28.392780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44831e3-c050-417e-8435-2da2bbb5d096 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:28.409092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:28.413936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:28.414227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:28.414494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:28.415209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:28.423924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:28.471125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:28.472112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 705/1395] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:28.490399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa97946-9ae5-4b5a-a20a-a4ff682feffe admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:28.520647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:28.521358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:28.521678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:28.522024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] PATH_INFO: `/v3/projects/eba983114c5145bdbfa7f92bede726eb/users/7be4d7edd77341679175dbe73643c41c/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:28.564770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba983114c5145bdbfa7f92bede726eb, user_id=7be4d7edd77341679175dbe73643c41c, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:28.593344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:28.615378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:28.621545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:28.631456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 691/1396] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:28 2022] PUT /identity/v3/projects/eba983114c5145bdbfa7f92bede726eb/users/7be4d7edd77341679175dbe73643c41c/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:28.631456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:28.636777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:28.824263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bbaca-54b6-4daf-be92-ca91d888d995 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:28.828244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:28.828889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:28.829191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:28.829485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:28.848194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:28.924464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f399-a73a-4eb2-bbf2-ad33c5ebe4b0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:29.031737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:29.033509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:29.055966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 692/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:29.056969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:29.125532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:29.131341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef50ad0-7c90-4383-a081-19afb6e17679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:29.133505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef50ad0-7c90-4383-a081-19afb6e17679 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:29.133938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef50ad0-7c90-4383-a081-19afb6e17679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:29.134220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef50ad0-7c90-4383-a081-19afb6e17679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:29.208203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccea1b-0eb8-4cea-b30d-2c654db90d58 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:29.224450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:29.225880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:29.225880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:29.225880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:29.226384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:29.228791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:29.250127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:29.275267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 693/1398] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:29.276643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:29.281470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef50ad0-7c90-4383-a081-19afb6e17679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:29.283411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef50ad0-7c90-4383-a081-19afb6e17679 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:29.304905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a4dc5-18ab-4a06-942a-6bc5fb91ad08 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:29.318257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:29.319283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:29.319569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:29.319845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] PATH_INFO: `/v3/projects/eba983114c5145bdbfa7f92bede726eb/users/7be4d7edd77341679175dbe73643c41c/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:29.321867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba983114c5145bdbfa7f92bede726eb, user_id=7be4d7edd77341679175dbe73643c41c, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:29.324925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 706/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:29.325186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:29.345943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 694/1400] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:29 2022] PUT /identity/v3/projects/eba983114c5145bdbfa7f92bede726eb/users/7be4d7edd77341679175dbe73643c41c/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:29.357564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307c493-48ed-4885-91af-45ec95252ba5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:29.357887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307c493-48ed-4885-91af-45ec95252ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:29.359039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307c493-48ed-4885-91af-45ec95252ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:29.460570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7307c493-48ed-4885-91af-45ec95252ba5 None None] MFA Rules not processed for user `7be4d7edd77341679175dbe73643c41c`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:29.461839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7307c493-48ed-4885-91af-45ec95252ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:29.707190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 707/1401] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:29.726957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:29.729031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:29.871420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86a60-1b92-4d2f-961a-5c439edfc310 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:29.900659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:29.901736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:29.902165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:29.902590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:29.924573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:29.926910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:29.960006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 695/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:30.252669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307c493-48ed-4885-91af-45ec95252ba5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:30.277875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307c493-48ed-4885-91af-45ec95252ba5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:30.300336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9dea7-c719-4e26-add6-9947dd09a5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:30.302165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9dea7-c719-4e26-add6-9947dd09a5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:30.303975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9dea7-c719-4e26-add6-9947dd09a5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:30.304270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9dea7-c719-4e26-add6-9947dd09a5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:30.309261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b4e9dea7-c719-4e26-add6-9947dd09a5f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:30.568803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9dea7-c719-4e26-add6-9947dd09a5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:30.573003 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9dea7-c719-4e26-add6-9947dd09a5f5 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:30.596756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 708/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:30.723648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:30.725141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:30.918081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:30.918625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:30.918734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:31.080139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa008c8-d318-4e95-bd0c-52546dc40482 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:31.103377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:31.106742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:31.107594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:31.110415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] PATH_INFO: `/v3/projects/bd3bd067440f4953920348efaafe66fa` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:31.114854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3bd067440f4953920348efaafe66fa)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:31.125776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:31.132700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:31.135921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:31.255145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:31.298465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3bd067440f4953920348efaafe66fa', 'request_id': 'req-c8f59c03-3b42-4211-b528-0eb016fe8c4c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.304968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:31.316611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3bd067440f4953920348efaafe66fa', 'request_id': 'req-c8f59c03-3b42-4211-b528-0eb016fe8c4c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.343255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3bd067440f4953920348efaafe66fa', 'request_id': 'req-c8f59c03-3b42-4211-b528-0eb016fe8c4c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.383819 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] The token cache is being invalidate because project bd3bd067440f4953920348efaafe66fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:31.384112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.387933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.395104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 696/1404] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:30 2022] DELETE /identity/v3/projects/bd3bd067440f4953920348efaafe66fa => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:31.400027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:31.400967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 709/1405] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:27:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:31.403688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:31.723681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f59c03-3b42-4211-b528-0eb016fe8c4c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:31.747627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:31.748421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:31.748754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:31.749045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] PATH_INFO: `/v3/users/bf9294bce7084b77b157e5a4fe206a2f` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:31.758120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9294bce7084b77b157e5a4fe206a2f)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:31.760383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:31.762529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:31.764710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:31.954412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9294bce7084b77b157e5a4fe206a2f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.985560 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9294bce7084b77b157e5a4fe206a2f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.986338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9294bce7084b77b157e5a4fe206a2f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:31.987456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9294bce7084b77b157e5a4fe206a2f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:32.017816 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9294bce7084b77b157e5a4fe206a2f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:32.057539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 697/1406] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:31 2022] DELETE /identity/v3/users/bf9294bce7084b77b157e5a4fe206a2f => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:32.149998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af5dc6-015e-4cbb-a6ac-6d701da00150 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:32.328669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3a97c-c1c6-4c69-adf9-449110a56277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:32.329320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3a97c-c1c6-4c69-adf9-449110a56277 service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:32.329602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3a97c-c1c6-4c69-adf9-449110a56277 service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:32.329881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3a97c-c1c6-4c69-adf9-449110a56277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:32.335903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b1f3a97c-c1c6-4c69-adf9-449110a56277 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:32.378172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:32.381113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:32.513470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3a97c-c1c6-4c69-adf9-449110a56277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:32.517883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3a97c-c1c6-4c69-adf9-449110a56277 service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:32.532100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:32.541600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 710/1407] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:27:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:27:32.604602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee37b1-54d6-401e-893a-3f00dc922afd admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:32.621017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:32.621776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:32.622323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:32.622685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] PATH_INFO: `/v3/projects/1397c4891c9e4fb8bdd4b93d866f3f74` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:32.625935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1397c4891c9e4fb8bdd4b93d866f3f74)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:32.628425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:32.637271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:32.789214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1397c4891c9e4fb8bdd4b93d866f3f74', 'request_id': 'req-160a92c1-59fb-4378-991f-e41524103e2b'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:32.817515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1397c4891c9e4fb8bdd4b93d866f3f74', 'request_id': 'req-160a92c1-59fb-4378-991f-e41524103e2b'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:32.833379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1397c4891c9e4fb8bdd4b93d866f3f74', 'request_id': 'req-160a92c1-59fb-4378-991f-e41524103e2b'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:32.898927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] The token cache is being invalidate because project 1397c4891c9e4fb8bdd4b93d866f3f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:32.903138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:32.904283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-160a92c1-59fb-4378-991f-e41524103e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:32.912220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 698/1408] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:32 2022] DELETE /identity/v3/projects/1397c4891c9e4fb8bdd4b93d866f3f74 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:32.914114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2dca-eefa-4faa-9696-dab527687b36 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:32.914840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2dca-eefa-4faa-9696-dab527687b36 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:32.914840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2dca-eefa-4faa-9696-dab527687b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:32.993201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-387e2dca-eefa-4faa-9696-dab527687b36 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:32.998904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-387e2dca-eefa-4faa-9696-dab527687b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:33.054100 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:33.054557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:33.055027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:33.209259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] MFA Rules not processed for user `532592384a174f4aade6ab3565fd32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:33.219776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:33.380881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 711/1409] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:33.382693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f399-407c-4512-b0ed-c666b6b2f942 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:33.384214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f399-407c-4512-b0ed-c666b6b2f942 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:33.385151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f399-407c-4512-b0ed-c666b6b2f942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:33.464218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-14f8f399-407c-4512-b0ed-c666b6b2f942 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:33.468675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-14f8f399-407c-4512-b0ed-c666b6b2f942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:33.521110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 712/1410] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:33.524507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f399-407c-4512-b0ed-c666b6b2f942 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:33.570180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f399-407c-4512-b0ed-c666b6b2f942 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:33.580347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:33.581591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:33.583541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:33.584972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:33.585782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:33.589386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:33.597126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:33.632096 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 699/1411] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:33.639904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:33.641442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:33.671673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 713/1412] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:33.679426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:33.714299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c9cb9-f9aa-4269-8cd4-df15ba8eb688 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:33.727186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:33.727814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:33.728093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:33.731193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:33.732638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:33.740707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:33.827994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 714/1413] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:33 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:33.829147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:33.936925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998f0fc-3a8b-423c-9221-3bc2f57d30d5 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:33.967608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:34.048776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebba21-dc78-4fa8-a8db-69a88750e519 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:34.074574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:34.075657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.075657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.075881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.085920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:34.100359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:34.103220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf6872-d7fb-46f2-ba85-72ca001d3f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:34.103874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf6872-d7fb-46f2-ba85-72ca001d3f8c service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.104378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf6872-d7fb-46f2-ba85-72ca001d3f8c service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.104949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf6872-d7fb-46f2-ba85-72ca001d3f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.180983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 715/1414] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:33 2022] POST /identity/v3/users => generated 303 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:34.185477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:34.258793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35428-bd81-44ac-8aef-f1a396441f15 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:34.265602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf6872-d7fb-46f2-ba85-72ca001d3f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:34.267952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf6872-d7fb-46f2-ba85-72ca001d3f8c service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:34.278852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:34.280044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.285069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.286147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.287434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:34.323068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:34.326673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 700/1415] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:34.330383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.333101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.334254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.377209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 716/1416] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:34.381478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:34.387623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:34.405263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4e104-793e-4369-9e47-4a277a4da0ba admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:34.416341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:34.418184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.418900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.419512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] PATH_INFO: `/v3/projects/ec27c1c26a504490a5b6dc12bf15c9f0` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.421362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec27c1c26a504490a5b6dc12bf15c9f0)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:34.424662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:34.454743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] MFA Rules not processed for user `18ae891c0f6742caaa94c3673f03628c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:34.461929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:34.524749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:34.577173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec27c1c26a504490a5b6dc12bf15c9f0', 'request_id': 'req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:34.606049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec27c1c26a504490a5b6dc12bf15c9f0', 'request_id': 'req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:34.625976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec27c1c26a504490a5b6dc12bf15c9f0', 'request_id': 'req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:34.645877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] The token cache is being invalidate because project ec27c1c26a504490a5b6dc12bf15c9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:34.646567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:34.647997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:34.656577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 717/1417] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:34 2022] DELETE /identity/v3/projects/ec27c1c26a504490a5b6dc12bf15c9f0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:34.658242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:34.660309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:34.783370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 701/1418] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:34.784432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:34.788734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:34.837387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5428e-29f4-4ae7-bf6a-8aa9de5d351b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:34.842980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:34.843950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.844725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.845431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] PATH_INFO: `/v3/users/979ed4833c4b4a41b786bd3040736819` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.847682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979ed4833c4b4a41b786bd3040736819)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:34.851071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:34.866278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176aae8-6be5-493a-9fb7-b7c0278bc0ad admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:34.888037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148d2b2-af8f-4071-b16f-363a640436f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:34.891542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d2b2-af8f-4071-b16f-363a640436f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.891887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d2b2-af8f-4071-b16f-363a640436f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.892254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d2b2-af8f-4071-b16f-363a640436f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.895230 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148d2b2-af8f-4071-b16f-363a640436f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:34.910735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148d2b2-af8f-4071-b16f-363a640436f8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:34.964203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 718/1419] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:34.969618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223262-c966-4b3d-b10c-6f7e477f52f1 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:34.971095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223262-c966-4b3d-b10c-6f7e477f52f1 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:34.976029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223262-c966-4b3d-b10c-6f7e477f52f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:34.984814 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:35.006363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979ed4833c4b4a41b786bd3040736819'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:35.040419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979ed4833c4b4a41b786bd3040736819'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:35.041984 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979ed4833c4b4a41b786bd3040736819'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:35.048704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979ed4833c4b4a41b786bd3040736819'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:35.059828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-98223262-c966-4b3d-b10c-6f7e477f52f1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:35.061341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-98223262-c966-4b3d-b10c-6f7e477f52f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:35.066929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979ed4833c4b4a41b786bd3040736819'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:35.087724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 719/1420] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:35.100164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:35.100520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:35.100748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:35.141600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 702/1421] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:34 2022] DELETE /identity/v3/users/979ed4833c4b4a41b786bd3040736819 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:35.142245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:35.155270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:35.181355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] MFA Rules not processed for user `18ae891c0f6742caaa94c3673f03628c`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:35.182627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:35.372582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1baf-23df-4cff-a812-cde844110878 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:35.394003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d295d6b-2540-47ec-89a9-107aa3ddc2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:35.395019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d295d6b-2540-47ec-89a9-107aa3ddc2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:35.395529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d295d6b-2540-47ec-89a9-107aa3ddc2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:35.401196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d295d6b-2540-47ec-89a9-107aa3ddc2e4 admin admin] PATH_INFO: `/v3/projects/eb1b4af3fe944bd2b4a97f59034ddcb3/users/4934e3edb65f46aa95c4b5b99b2a9bcd/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:35.434317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 720/1422] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:35.435509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:35.438925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:35.476519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d295d6b-2540-47ec-89a9-107aa3ddc2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1b4af3fe944bd2b4a97f59034ddcb3, user_id=4934e3edb65f46aa95c4b5b99b2a9bcd, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:35.486104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d295d6b-2540-47ec-89a9-107aa3ddc2e4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:35.499360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6b339-a279-4a9e-967e-07bcbbf7e16d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:35.522860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:35.524630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:35.528735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:35.529101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] PATH_INFO: `/v3/users/58aa4552173645cbaf97f8ce92767663` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:35.532900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58aa4552173645cbaf97f8ce92767663)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:35.537148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 703/1423] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:35 2022] PUT /identity/v3/projects/eb1b4af3fe944bd2b4a97f59034ddcb3/users/4934e3edb65f46aa95c4b5b99b2a9bcd/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:35.540976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5242d8-1bbc-48bf-b67e-0747e8825fa0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:35.541259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5242d8-1bbc-48bf-b67e-0747e8825fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:35.542928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:35.545729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5242d8-1bbc-48bf-b67e-0747e8825fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:35.616723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3e5242d8-1bbc-48bf-b67e-0747e8825fa0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:35.624484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3e5242d8-1bbc-48bf-b67e-0747e8825fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:35.796371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 704/1424] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:35.805447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:35.805846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:35.806142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:35.858783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:35.875193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:35.932642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 705/1425] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:35.934184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:35.936738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.093663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58aa4552173645cbaf97f8ce92767663'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:36.101016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:36.126860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:36.127702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58aa4552173645cbaf97f8ce92767663'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:36.132733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58aa4552173645cbaf97f8ce92767663'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:36.138560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58aa4552173645cbaf97f8ce92767663'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:36.169608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-25b4e048-2b16-47cb-854f-a450eb15c5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58aa4552173645cbaf97f8ce92767663'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:36.260067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 721/1426] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:35 2022] DELETE /identity/v3/users/58aa4552173645cbaf97f8ce92767663 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:36.271667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.276815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.277107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.308873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db4ede-ddaf-44ec-8b5a-5bcdafcbc0d7 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:36.393243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] MFA Rules not processed for user `4934e3edb65f46aa95c4b5b99b2a9bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:36.395263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.563358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:36.563991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.565208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.565502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.567450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.586246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 722/1427] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:36.587489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:36.589257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.660138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:36.663122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:36.680801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b9d4c-9337-4453-b813-0ea85957b17c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:36.686811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd0db9-c689-48f8-9ae0-5c27ec4db804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:36.687713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd0db9-c689-48f8-9ae0-5c27ec4db804 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.687985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd0db9-c689-48f8-9ae0-5c27ec4db804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.688318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd0db9-c689-48f8-9ae0-5c27ec4db804 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.688973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 706/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:36.689078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd0db9-c689-48f8-9ae0-5c27ec4db804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:36.689328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd0db9-c689-48f8-9ae0-5c27ec4db804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:36.690224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:36.692519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd0db9-c689-48f8-9ae0-5c27ec4db804 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:36.695455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.712609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 723/1429] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:36.718413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798cac-d5c6-4c43-a37b-329a21a2890b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.719869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798cac-d5c6-4c43-a37b-329a21a2890b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.720614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798cac-d5c6-4c43-a37b-329a21a2890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.805442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d7798cac-d5c6-4c43-a37b-329a21a2890b None None] MFA Rules not processed for user `ed8635b4ce034605bcce301f3f98e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:36.807009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d7798cac-d5c6-4c43-a37b-329a21a2890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.836148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2fc3c-187f-45f3-8064-a4e72cc29276 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:36.842330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 724/1430] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 11 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:36.845651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.847598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.848057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.852847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315fcf3-001a-4326-8f06-05b84b78f64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:36.853490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315fcf3-001a-4326-8f06-05b84b78f64f service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.853764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315fcf3-001a-4326-8f06-05b84b78f64f service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.854031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315fcf3-001a-4326-8f06-05b84b78f64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.856006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4315fcf3-001a-4326-8f06-05b84b78f64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.891737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315fcf3-001a-4326-8f06-05b84b78f64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:36.894610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315fcf3-001a-4326-8f06-05b84b78f64f service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:36.916905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 707/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:36.918533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.918831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.919106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.956469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:36.960022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.970865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 725/1432] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:36.972012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:36.974637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.986469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:36.991785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7031a-a9ac-47d9-976b-5d797b7c54de None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:36.995637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] MFA Rules not processed for user `4ac6d0fcbeb7496db5bb873d99e1c20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:36.996893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:36.997081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:36.998009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:36.998385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:36.999057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:36.999947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.002851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.074589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 726/1433] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:36 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:37.093551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.147545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:37.183067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 708/1434] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:37.195812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.198833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:37.228186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed7054-48bf-46b9-a311-f4a57eab45cf None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.266616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2c6ab-18be-4f1a-8789-5d00303c7e3a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.285012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.286427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.287554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.288143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.291531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.296833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.391511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 727/1435] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:37 2022] POST /identity/v3/projects => generated 367 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:37.393576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.397336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.398804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.400361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.401098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.420841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.423940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.455351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 709/1436] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:37.456744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.476511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295467e-6255-4229-9d07-89f576875d1f service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.550090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360903-7a43-4e8f-912f-98f94023af77 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.562798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.563640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.565224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.565604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.566366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.571427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.588843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.589647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.590099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.590468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.614886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.617386 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.617827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 728/1437] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:37 2022] POST /identity/v3/users => generated 308 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:37.620146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.628377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:37.654528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 710/1438] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:37.655921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.680138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c410b-f71f-45a7-91e4-cc19c70ef2c8 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.691544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503469-9e75-4ecb-9545-e6f453cc18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.692347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503469-9e75-4ecb-9545-e6f453cc18d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.692743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503469-9e75-4ecb-9545-e6f453cc18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.693102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503469-9e75-4ecb-9545-e6f453cc18d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.693845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503469-9e75-4ecb-9545-e6f453cc18d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.697159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503469-9e75-4ecb-9545-e6f453cc18d1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.740297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 711/1439] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:37 2022] POST /identity/v3/users => generated 284 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:37.742728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee3b6f-0660-4ad4-bd4d-f904cb70ef10 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.743343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee3b6f-0660-4ad4-bd4d-f904cb70ef10 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.744512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee3b6f-0660-4ad4-bd4d-f904cb70ef10 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.754249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 712/1440] 10.222.0.16 () {54 vars in 912 bytes} [Tue Oct 11 13:27:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:37.755392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee3b6f-0660-4ad4-bd4d-f904cb70ef10 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.787479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee3b6f-0660-4ad4-bd4d-f904cb70ef10 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.796602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16193443-c092-4aca-b0e4-852eabe83d49 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.798715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.799705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.800174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.800543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.801300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.805526 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.818590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.819489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.819972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.820393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.833647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 713/1441] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:37.834888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:37.860611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0c84-f863-430d-94dc-cde1c3196930 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:37.880618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a226f-b1fc-4e6f-a5ca-5f65982992db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:37.887467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a226f-b1fc-4e6f-a5ca-5f65982992db admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.889199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a226f-b1fc-4e6f-a5ca-5f65982992db admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.889809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a226f-b1fc-4e6f-a5ca-5f65982992db admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:37.891292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a226f-b1fc-4e6f-a5ca-5f65982992db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:37.898241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a226f-b1fc-4e6f-a5ca-5f65982992db admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:37.903257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:37.929669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 714/1442] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:37.935090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30740-4f04-4379-a28b-68d82a735610 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:37.938786 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30740-4f04-4379-a28b-68d82a735610 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:37.939230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30740-4f04-4379-a28b-68d82a735610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:38.003992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:38.006367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8de30740-4f04-4379-a28b-68d82a735610 None None] MFA Rules not processed for user `ed8635b4ce034605bcce301f3f98e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:38.006882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:38.012961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8de30740-4f04-4379-a28b-68d82a735610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:38.028260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 715/1443] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:27:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:38.036881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de30740-4f04-4379-a28b-68d82a735610 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:38.038008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 729/1444] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:38.039617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:38.050380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:38.064661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2ebb8-d79b-41a9-b5a6-475d297fc25f service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:38.065156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de30740-4f04-4379-a28b-68d82a735610 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:38.074783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:38.075208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:38.076125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:38.077113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:38.077597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:38.078075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:38.078547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:38.079137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] PATH_INFO: `/v3/projects/d0585ce9a222455482a7fbc6436fbb32/users/87158af09717434581c69bca2779ad40/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:38.080018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:38.083118 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:38.102786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 730/1445] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:38.108948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:38.115147 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0585ce9a222455482a7fbc6436fbb32, user_id=87158af09717434581c69bca2779ad40, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:38.121525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:38.130424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4668b-293b-419e-b891-e5777de11ec5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:38.142767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc130698-72d0-47d7-88c9-7be11285f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:38.145889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc130698-72d0-47d7-88c9-7be11285f113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:38.147075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 716/1446] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:38 2022] PUT /identity/v3/projects/d0585ce9a222455482a7fbc6436fbb32/users/87158af09717434581c69bca2779ad40/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:38.147469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc130698-72d0-47d7-88c9-7be11285f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:38.147945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc130698-72d0-47d7-88c9-7be11285f113 admin admin] PATH_INFO: `/v3/projects/fcd57b9f54d0451585b8db09b449e041/users/ac08428414574a678ce7b54d8929bed6/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:38.151935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:38.190541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc130698-72d0-47d7-88c9-7be11285f113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd57b9f54d0451585b8db09b449e041, user_id=ac08428414574a678ce7b54d8929bed6, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:38.195075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc130698-72d0-47d7-88c9-7be11285f113 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:38.224879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 731/1447] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:38 2022] PUT /identity/v3/projects/fcd57b9f54d0451585b8db09b449e041/users/ac08428414574a678ce7b54d8929bed6/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:38.238623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292294c8-dc23-48b8-a11a-bfb196853954 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:38.239256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292294c8-dc23-48b8-a11a-bfb196853954 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:38.239952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292294c8-dc23-48b8-a11a-bfb196853954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:38.335653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-292294c8-dc23-48b8-a11a-bfb196853954 None None] MFA Rules not processed for user `ac08428414574a678ce7b54d8929bed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:38.338893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-292294c8-dc23-48b8-a11a-bfb196853954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:38.347827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873086a-b871-45f5-aa2e-131078fa0552 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:38.585420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:38.587475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:38.589412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:38.590582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:38.594550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:38.601880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:38.603425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 732/1448] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:38.606860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292294c8-dc23-48b8-a11a-bfb196853954 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:38.648684 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 717/1449] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:38.649875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:38.692228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2e10-9d84-4fbd-ac99-626fbec8c3fb admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:38.710681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:38.715491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:38.717726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:38.719189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:38.719997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:38.725008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:38.825450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 718/1450] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:38 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:38.827676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292294c8-dc23-48b8-a11a-bfb196853954 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:38.832538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:38.940900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:38.982272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:38.983085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:38.983639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:38.984460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.013384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:39.015281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:39.018689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63761807-333e-4c86-a593-8f6d93ae4fa3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:39.043089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 733/1451] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:39.044405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20db76-faed-400a-9db7-eb82a0402324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:39.045070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20db76-faed-400a-9db7-eb82a0402324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.045238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20db76-faed-400a-9db7-eb82a0402324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.045337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:39.045511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20db76-faed-400a-9db7-eb82a0402324 admin admin] PATH_INFO: `/v3/projects/d0585ce9a222455482a7fbc6436fbb32/users/87158af09717434581c69bca2779ad40/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.053235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20db76-faed-400a-9db7-eb82a0402324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0585ce9a222455482a7fbc6436fbb32, user_id=87158af09717434581c69bca2779ad40, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:39.057642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20db76-faed-400a-9db7-eb82a0402324 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:39.067972 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:39.075819 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a7a13-2d8c-43cf-b662-cd1d28d930ce service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:39.102016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:39.102016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.102016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.102016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.102554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:39.102554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:39.105757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 719/1452] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:38 2022] PUT /identity/v3/projects/d0585ce9a222455482a7fbc6436fbb32/users/87158af09717434581c69bca2779ad40/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:39.107507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.109450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.109875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.160471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 734/1453] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:39 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:39.164794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:39.187920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] MFA Rules not processed for user `87158af09717434581c69bca2779ad40`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:39.189389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:39.190388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546b0fb-62c8-4fc3-ae91-d274484f1225 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:39.400288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 720/1454] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:39.405794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:39.406802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:39.407688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.408134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.408961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:39.409585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.410801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:39.425374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:39.465860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 735/1455] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:27:39.467016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:39.474321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:39.528120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fe05-5f5c-4761-acf9-13c3b4f4cfe5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:39.547375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:39.548269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.548710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.549121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] PATH_INFO: `/v3/projects/84838a753b1d4eb88988aca6ab179a7b` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.551861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84838a753b1d4eb88988aca6ab179a7b)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:39.552081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2161cd7-1c4a-482c-8b12-66ba097cfb5c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:39.556717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:39.562108 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:39.562750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.563055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.563394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.602716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:39.604368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:39.644311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 721/1456] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:27:39.645282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:39.698495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84838a753b1d4eb88988aca6ab179a7b', 'request_id': 'req-d4100dd8-2436-43ad-8d94-ffef1991f69d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:39.700130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605225-f184-4d78-8c85-20d6b62e1fdc service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:39.709625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84838a753b1d4eb88988aca6ab179a7b', 'request_id': 'req-d4100dd8-2436-43ad-8d94-ffef1991f69d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:39.728230 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84838a753b1d4eb88988aca6ab179a7b', 'request_id': 'req-d4100dd8-2436-43ad-8d94-ffef1991f69d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:39.760753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] The token cache is being invalidate because project 84838a753b1d4eb88988aca6ab179a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:39.761135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:39.763200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:39.768444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 736/1457] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:39 2022] DELETE /identity/v3/projects/84838a753b1d4eb88988aca6ab179a7b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:39.773195 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:39.775747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:39.854613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2278e-9c5c-4409-bdfa-77d4a810bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:39.855355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2278e-9c5c-4409-bdfa-77d4a810bac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.855655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2278e-9c5c-4409-bdfa-77d4a810bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.855905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2278e-9c5c-4409-bdfa-77d4a810bac4 admin admin] PATH_INFO: `/v3/projects/94c44c793aac4c2a91f7b5a73266e3b4/users/5d1551b3c320451f87a04d1f3f305689/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.889609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2278e-9c5c-4409-bdfa-77d4a810bac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c44c793aac4c2a91f7b5a73266e3b4, user_id=5d1551b3c320451f87a04d1f3f305689, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:39.892330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2278e-9c5c-4409-bdfa-77d4a810bac4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:39.928417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:39.940543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 722/1458] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:39 2022] PUT /identity/v3/projects/94c44c793aac4c2a91f7b5a73266e3b4/users/5d1551b3c320451f87a04d1f3f305689/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:39.951886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622bb0f-1d5b-4835-bdd9-750650f9330f None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:39.953971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622bb0f-1d5b-4835-bdd9-750650f9330f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:39.954441 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622bb0f-1d5b-4835-bdd9-750650f9330f None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:39.956241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 723/1459] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:27:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:39.959751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622bb0f-1d5b-4835-bdd9-750650f9330f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:39.972581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3622bb0f-1d5b-4835-bdd9-750650f9330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:39.987929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4100dd8-2436-43ad-8d94-ffef1991f69d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:39.998122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:40.188467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622bb0f-1d5b-4835-bdd9-750650f9330f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:40.197028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:40.197738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:40.198116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:40.198412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:40.199159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:40.200903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:40.250607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 724/1460] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:40.251614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:40.262831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:40.296922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a3d0-1547-4e1e-a14f-b636bd908211 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:40.330233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:40.331175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:40.339239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:40.339709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:40.340184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] PATH_INFO: `/v3/users/7be4d7edd77341679175dbe73643c41c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:40.342536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be4d7edd77341679175dbe73643c41c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:40.343137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:40.343552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:40.343766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] PATH_INFO: `/v3/users/4934e3edb65f46aa95c4b5b99b2a9bcd` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:40.345150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4934e3edb65f46aa95c4b5b99b2a9bcd)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:40.347270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:40.350588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:40.469260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4934e3edb65f46aa95c4b5b99b2a9bcd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.484717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4934e3edb65f46aa95c4b5b99b2a9bcd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.492595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4934e3edb65f46aa95c4b5b99b2a9bcd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.494038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4934e3edb65f46aa95c4b5b99b2a9bcd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.494744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be4d7edd77341679175dbe73643c41c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.512635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be4d7edd77341679175dbe73643c41c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.514154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be4d7edd77341679175dbe73643c41c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.514750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ed99bae-6c79-4d1c-9eb5-5eeea7fa9fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4934e3edb65f46aa95c4b5b99b2a9bcd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.515062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be4d7edd77341679175dbe73643c41c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.530426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be4d7edd77341679175dbe73643c41c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:40.565004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 725/1461] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:40 2022] DELETE /identity/v3/users/4934e3edb65f46aa95c4b5b99b2a9bcd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:40.568964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80edc73-fad4-45ef-a0c5-c14b7992fc2b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:40.571409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80edc73-fad4-45ef-a0c5-c14b7992fc2b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:40.572527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80edc73-fad4-45ef-a0c5-c14b7992fc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:40.639101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 737/1462] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:39 2022] DELETE /identity/v3/users/7be4d7edd77341679175dbe73643c41c => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:40.644199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:40.653090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:40.669636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f80edc73-fad4-45ef-a0c5-c14b7992fc2b None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:40.681242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f80edc73-fad4-45ef-a0c5-c14b7992fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:40.829383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 726/1463] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:27:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:40.832607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8d590-7deb-4738-a060-932d79b1f7d8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:40.832761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8d590-7deb-4738-a060-932d79b1f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:40.833037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8d590-7deb-4738-a060-932d79b1f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:40.849706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:40.874547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1eb8d590-7deb-4738-a060-932d79b1f7d8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:40.877389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1eb8d590-7deb-4738-a060-932d79b1f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:40.884553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c31e15-8b55-48e7-a8af-81e91b0bd51e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:40.905309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 727/1464] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:40.911339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:40.913859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:40.914202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:40.914539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] PATH_INFO: `/v3/projects/94c44c793aac4c2a91f7b5a73266e3b4/users/5d1551b3c320451f87a04d1f3f305689/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:40.918487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c44c793aac4c2a91f7b5a73266e3b4, user_id=5d1551b3c320451f87a04d1f3f305689, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:40.921206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:40.953697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 738/1465] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:40 2022] PUT /identity/v3/projects/94c44c793aac4c2a91f7b5a73266e3b4/users/5d1551b3c320451f87a04d1f3f305689/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:40.968736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36761-5d9e-4717-8368-894e8a355941 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:40.969759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36761-5d9e-4717-8368-894e8a355941 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:40.970115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36761-5d9e-4717-8368-894e8a355941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:41.021696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:41.024204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:41.030384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:41.065905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-aed36761-5d9e-4717-8368-894e8a355941 None None] MFA Rules not processed for user `5d1551b3c320451f87a04d1f3f305689`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:41.072471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-aed36761-5d9e-4717-8368-894e8a355941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:41.229893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 728/1466] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:41.248734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:41.249421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:41.249934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:41.280783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] MFA Rules not processed for user `532592384a174f4aade6ab3565fd32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:41.286908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:41.315976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e85ce-4de5-43af-8b3b-bc6224328c48 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:41.332133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:41.335981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:41.345613 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:41.345815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:41.573848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 729/1467] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:41.576762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:41.579663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:41.636132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:41.644983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:41.693287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 739/1468] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:27:41.696149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:41.699715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:41.732764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46609418-eafa-4fae-9d50-f510a3247a7c service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:41.739263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:41.740206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:41.740859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:41.741394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] PATH_INFO: `/v3/projects/a7cf6dd4abb74c74a9b0cd9bcfdcf9a3` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:41.743421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7cf6dd4abb74c74a9b0cd9bcfdcf9a3)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:41.746567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:41.752066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4796-3aa9-4911-80b6-73809ad46a4f None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:41.763794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:41.764494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:41.764771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:41.765039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:41.799391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:41.801359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:41.845807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 730/1469] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:41.845807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:41.851164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:41.928282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7cf6dd4abb74c74a9b0cd9bcfdcf9a3', 'request_id': 'req-72b5529c-1acc-4f10-be60-577505a919ed'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:41.944905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7cf6dd4abb74c74a9b0cd9bcfdcf9a3', 'request_id': 'req-72b5529c-1acc-4f10-be60-577505a919ed'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:41.964073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:41.965261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7cf6dd4abb74c74a9b0cd9bcfdcf9a3', 'request_id': 'req-72b5529c-1acc-4f10-be60-577505a919ed'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.016404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] The token cache is being invalidate because project a7cf6dd4abb74c74a9b0cd9bcfdcf9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:42.016820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.017708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.025441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 740/1470] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:41 2022] DELETE /identity/v3/projects/a7cf6dd4abb74c74a9b0cd9bcfdcf9a3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:42.026680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:42.032959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:42.112703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dadc62-769f-495c-b743-b40ba54bb601 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:42.138595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:42.212341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5529c-1acc-4f10-be60-577505a919ed admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:42.233935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:42.234859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:42.235205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:42.235703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] PATH_INFO: `/v3/users/c3970396f9724d2da0372fee19544a21` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:42.240580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3970396f9724d2da0372fee19544a21)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:42.243715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:42.387898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3970396f9724d2da0372fee19544a21'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.394812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:42.396338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:42.397014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:42.397831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:42.401634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:42.426770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3970396f9724d2da0372fee19544a21'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.427619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3970396f9724d2da0372fee19544a21'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.428277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3970396f9724d2da0372fee19544a21'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.443481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e21e094d-4a79-40a2-8907-1b8461a63213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3970396f9724d2da0372fee19544a21'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:42.453471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:42.456192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:42.501976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 731/1471] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:42.504281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:42.506183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:42.515248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 741/1472] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:42 2022] DELETE /identity/v3/users/c3970396f9724d2da0372fee19544a21 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:42.527046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0de36-68a2-443a-b4ef-7ef271eab9a5 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:42.769927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:42.772046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:42.772331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:42.772615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] PATH_INFO: `/v3/projects/eba983114c5145bdbfa7f92bede726eb` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:42.778809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba983114c5145bdbfa7f92bede726eb)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:42.787916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:43.004982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba983114c5145bdbfa7f92bede726eb', 'request_id': 'req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:43.051167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba983114c5145bdbfa7f92bede726eb', 'request_id': 'req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:43.052948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:43.076823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba983114c5145bdbfa7f92bede726eb', 'request_id': 'req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:43.127872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] The token cache is being invalidate because project eba983114c5145bdbfa7f92bede726eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:43.135420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:43.139617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e4fcfcaa-424f-482f-84d1-1efcc7127ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:43.155617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 732/1473] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:42 2022] DELETE /identity/v3/projects/eba983114c5145bdbfa7f92bede726eb => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:43.161459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2ad2-0e83-4abb-990a-c467c88a446d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:43.161835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2ad2-0e83-4abb-990a-c467c88a446d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:43.162151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2ad2-0e83-4abb-990a-c467c88a446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:43.208117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-152a2ad2-0e83-4abb-990a-c467c88a446d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:43.209373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-152a2ad2-0e83-4abb-990a-c467c88a446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:43.455163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 742/1474] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:43.456503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744dbb-9fda-4339-8569-a38be5afd4b1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:43.456858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744dbb-9fda-4339-8569-a38be5afd4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:43.457191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744dbb-9fda-4339-8569-a38be5afd4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:43.524252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-ea744dbb-9fda-4339-8569-a38be5afd4b1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:43.525564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ea744dbb-9fda-4339-8569-a38be5afd4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:43.567943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 733/1475] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:43.575121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2ad2-0e83-4abb-990a-c467c88a446d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:43.618402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2ad2-0e83-4abb-990a-c467c88a446d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:43.659665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:43.660788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:43.661247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:43.661735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:43.663380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:43.663859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:43.678075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:43.743115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 743/1476] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:43.749141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744dbb-9fda-4339-8569-a38be5afd4b1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:43.767406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744dbb-9fda-4339-8569-a38be5afd4b1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:43.795707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:43.796741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:43.797058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:43.797321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:43.798056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:43.827218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:43.964797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 734/1477] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:43 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:43.970982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:44.014324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858852-6a5d-4a47-acf8-1d4eae9d7794 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:44.094989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:44.097138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:44.279783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:44.322154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e911c8-ff39-436a-8389-9fff47ca6a1d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:44.336861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:44.337720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:44.338066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:44.338524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] PATH_INFO: `/v3/projects/eb1b4af3fe944bd2b4a97f59034ddcb3` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:44.340325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1b4af3fe944bd2b4a97f59034ddcb3)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:44.344719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:44.415300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:44.418329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:44.418607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:44.421222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:44.421910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:44.430845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:44.516483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 744/1478] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:43 2022] POST /identity/v3/users => generated 291 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:44.523284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:44.532054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1b4af3fe944bd2b4a97f59034ddcb3', 'request_id': 'req-5de42a25-c9bf-45b6-9125-b41c958f36dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:44.556284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1b4af3fe944bd2b4a97f59034ddcb3', 'request_id': 'req-5de42a25-c9bf-45b6-9125-b41c958f36dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:44.558533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5a352-e819-4918-9646-3acbc3a88bc8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:44.598642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1b4af3fe944bd2b4a97f59034ddcb3', 'request_id': 'req-5de42a25-c9bf-45b6-9125-b41c958f36dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:44.621924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] The token cache is being invalidate because project eb1b4af3fe944bd2b4a97f59034ddcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:44.623936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:44.625755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:44.631689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 735/1479] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:44 2022] DELETE /identity/v3/projects/eb1b4af3fe944bd2b4a97f59034ddcb3 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:44.637141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:44.640693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:44.816550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:44.817193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:44.817472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:44.817743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:44.818395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:44.829788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:44.858088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:44.871564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 745/1480] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:44.871564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:44.897306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:44.955608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42a25-c9bf-45b6-9125-b41c958f36dd admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:44.965727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab5e6-3388-4fda-874a-6aec9f0d59d5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:44.980801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:44.984340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:44.985587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:44.987191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] PATH_INFO: `/v3/users/87158af09717434581c69bca2779ad40` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:44.989629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:44.990763 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:44.991567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=87158af09717434581c69bca2779ad40)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:44.992892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:44.994703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:44.998214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:45.006595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:45.007712 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:45.104729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 746/1481] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:45.106619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:45.151123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3df50-b59d-4b06-bb6c-e4f2bc4f9ea9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:45.187303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087be5e-620c-4eaa-8ccf-8f3b47c6b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:45.187894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087be5e-620c-4eaa-8ccf-8f3b47c6b0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:45.188272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087be5e-620c-4eaa-8ccf-8f3b47c6b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:45.188557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087be5e-620c-4eaa-8ccf-8f3b47c6b0d5 admin admin] PATH_INFO: `/v3/projects/1d23e2c5c19a4d82807725e144657522/users/80b6fd639a6543f199a11d5f61438fad/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:45.273362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87158af09717434581c69bca2779ad40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:45.287307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087be5e-620c-4eaa-8ccf-8f3b47c6b0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d23e2c5c19a4d82807725e144657522, user_id=80b6fd639a6543f199a11d5f61438fad, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:45.298635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087be5e-620c-4eaa-8ccf-8f3b47c6b0d5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:45.300558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87158af09717434581c69bca2779ad40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:45.303225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87158af09717434581c69bca2779ad40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:45.307111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87158af09717434581c69bca2779ad40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:45.337211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-36a49383-ccf9-4e20-8697-19befcb44e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87158af09717434581c69bca2779ad40'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:45.381606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 747/1482] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:45 2022] PUT /identity/v3/projects/1d23e2c5c19a4d82807725e144657522/users/80b6fd639a6543f199a11d5f61438fad/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:45.393578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 736/1483] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:44 2022] DELETE /identity/v3/users/87158af09717434581c69bca2779ad40 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:45.397658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511ef6-1eb9-49c0-9b2a-bd79c5f110d5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:45.397942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511ef6-1eb9-49c0-9b2a-bd79c5f110d5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:45.398216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511ef6-1eb9-49c0-9b2a-bd79c5f110d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:45.455246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:45.455809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:45.456211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:45.502562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-29511ef6-1eb9-49c0-9b2a-bd79c5f110d5 None None] MFA Rules not processed for user `80b6fd639a6543f199a11d5f61438fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:45.502799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] MFA Rules not processed for user `18ae891c0f6742caaa94c3673f03628c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:45.504581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:45.506362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-29511ef6-1eb9-49c0-9b2a-bd79c5f110d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:45.711406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 737/1484] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:45.737620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 748/1485] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:45.747817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:45.753631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:45.982555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50754904-f12b-42d4-9f48-126d0421e67a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:46.021442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:46.023242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.023242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.023242 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.023590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:46.028974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:46.071231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:46.094456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 738/1486] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:45 2022] POST /identity/v3/projects => generated 381 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:46.100681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511ef6-1eb9-49c0-9b2a-bd79c5f110d5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:46.101260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:46.104887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.136318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511ef6-1eb9-49c0-9b2a-bd79c5f110d5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:46.181042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:46.287961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577295d-f4f7-4f41-adf1-28c95030ad33 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:46.297233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:46.297911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.298184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.298460 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] PATH_INFO: `/v3/users/ac08428414574a678ce7b54d8929bed6` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.300006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac08428414574a678ce7b54d8929bed6)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:46.301981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:46.362298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:46.364020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.365883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.366171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.366869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:46.374028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:46.434852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 749/1487] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:46 2022] POST /identity/v3/users => generated 297 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:46.436851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:46.441886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac08428414574a678ce7b54d8929bed6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.442892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.461477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac08428414574a678ce7b54d8929bed6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.463255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac08428414574a678ce7b54d8929bed6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.464348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac08428414574a678ce7b54d8929bed6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.472509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7ee27-680f-4495-9cf5-2b43490b3399 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:46.480116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac08428414574a678ce7b54d8929bed6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.485798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:46.488330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.489320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.489611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] PATH_INFO: `/v3/projects/ab0fedecdee741bc8d11d86d71f7e8d7` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.493744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0fedecdee741bc8d11d86d71f7e8d7)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:46.497610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:46.520013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 739/1488] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:46 2022] DELETE /identity/v3/users/ac08428414574a678ce7b54d8929bed6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:46.521164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:46.523788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.617050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57052bdb-1e41-488f-b47d-81d990f10f68 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:46.627730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0fedecdee741bc8d11d86d71f7e8d7', 'request_id': 'req-037d5896-6506-42fd-accc-4a01f14b90d1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.660995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0fedecdee741bc8d11d86d71f7e8d7', 'request_id': 'req-037d5896-6506-42fd-accc-4a01f14b90d1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.661359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:46.673275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0fedecdee741bc8d11d86d71f7e8d7', 'request_id': 'req-037d5896-6506-42fd-accc-4a01f14b90d1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.707578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] The token cache is being invalidate because project ab0fedecdee741bc8d11d86d71f7e8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:46.707875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.708580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-037d5896-6506-42fd-accc-4a01f14b90d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:46.713301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 750/1489] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:46 2022] DELETE /identity/v3/projects/ab0fedecdee741bc8d11d86d71f7e8d7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:46.713301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.713301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.713301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.718835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7152e-cfc6-4fc9-aa46-ef7cace3c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:46.719662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7152e-cfc6-4fc9-aa46-ef7cace3c196 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.720024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7152e-cfc6-4fc9-aa46-ef7cace3c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.720418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7152e-cfc6-4fc9-aa46-ef7cace3c196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.721825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7152e-cfc6-4fc9-aa46-ef7cace3c196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:46.724229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7152e-cfc6-4fc9-aa46-ef7cace3c196 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:46.742032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 740/1490] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:46.743892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500d60d-d51b-499b-a249-990cec1f4ade None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.744472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500d60d-d51b-499b-a249-990cec1f4ade None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.744829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500d60d-d51b-499b-a249-990cec1f4ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.769611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:46.770854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.772601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e500d60d-d51b-499b-a249-990cec1f4ade None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:46.774255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e500d60d-d51b-499b-a249-990cec1f4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.790606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 751/1491] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:46.791489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:46.797393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.798172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 741/1492] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:46.800127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.800684 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.801040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.834574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2711e5-5354-4e79-8840-1cc3cdb11fe2 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:46.843626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:46.847406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.848054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:46.850395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:46.851651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:46.852362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] PATH_INFO: `/v3/projects/e0b75d55812e4614a33c405e99bbfcf3/users/2ffb9ed6636b4f00b3c21a0455d393f2/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:46.873806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 742/1493] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:46.879110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:46.882516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:46.898654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b75d55812e4614a33c405e99bbfcf3, user_id=2ffb9ed6636b4f00b3c21a0455d393f2, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:46.935353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:46.978211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 752/1494] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:46 2022] PUT /identity/v3/projects/e0b75d55812e4614a33c405e99bbfcf3/users/2ffb9ed6636b4f00b3c21a0455d393f2/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:46.982471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:47.121931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248a4-a7f4-4b64-9eba-e69f22796450 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:47.279080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3207912-429e-46c5-8cd5-0a3d6ef1e724 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:47.298593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:47.300608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.304730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.305410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:47.306361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:47.306916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:47.307730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c0cb-97e1-470b-b9c5-259933e73de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:47.308497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c0cb-97e1-470b-b9c5-259933e73de3 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.308778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c0cb-97e1-470b-b9c5-259933e73de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.309051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c0cb-97e1-470b-b9c5-259933e73de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:47.309820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:47.318225 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:47.346957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 753/1495] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:47.346957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:47.361867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c0cb-97e1-470b-b9c5-259933e73de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:47.363478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c0cb-97e1-470b-b9c5-259933e73de3 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:47.365794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be40f2-aaa5-4b8a-9c88-677319a5c6ac admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:47.389538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 743/1496] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:47.390788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.391737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:47.394540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.395374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.395673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:47.396391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.397198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:47.399456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:47.404786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:47.436783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 754/1497] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:47.438591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:47.466561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] MFA Rules not processed for user `4ac6d0fcbeb7496db5bb873d99e1c20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:47.472779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:47.482341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2079b-408a-46e0-b08e-526f0459c722 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:47.496409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:47.497417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.497417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.497762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:47.498385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:47.502714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:47.575269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 755/1498] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:47 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:47.576144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:47.620064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 744/1499] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:47.623616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:47.628647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:47.668095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b255-84d7-431e-b378-ab5af2afdbf1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:47.680271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:47.717204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2153d6-7475-44c8-9fbe-7cdd971e75a6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:47.723872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:47.724627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.724903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.725220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] PATH_INFO: `/v3/projects/e0b75d55812e4614a33c405e99bbfcf3/users/2ffb9ed6636b4f00b3c21a0455d393f2/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:47.728869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b75d55812e4614a33c405e99bbfcf3, user_id=2ffb9ed6636b4f00b3c21a0455d393f2, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:47.733369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:47.762932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 756/1500] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:47 2022] PUT /identity/v3/projects/e0b75d55812e4614a33c405e99bbfcf3/users/2ffb9ed6636b4f00b3c21a0455d393f2/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:47.764210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:47.810652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:47.811373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.811682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.812038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] PATH_INFO: `/v3/projects/d0585ce9a222455482a7fbc6436fbb32` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:47.816202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0585ce9a222455482a7fbc6436fbb32)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:47.821153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:47.933050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0585ce9a222455482a7fbc6436fbb32', 'request_id': 'req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:47.949434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0585ce9a222455482a7fbc6436fbb32', 'request_id': 'req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:47.957501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0585ce9a222455482a7fbc6436fbb32', 'request_id': 'req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:47.983274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] The token cache is being invalidate because project d0585ce9a222455482a7fbc6436fbb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:47.983578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:47.984514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a00d40ed-0afe-4d42-b632-0d404a2dd4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:47.996504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 745/1501] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:47 2022] DELETE /identity/v3/projects/d0585ce9a222455482a7fbc6436fbb32 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:47.998022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:47.998310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:47.998586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.036920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61750277-6ccc-4c64-8fb5-4b3f9b4ae0ec admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:48.087830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] MFA Rules not processed for user `2ffb9ed6636b4f00b3c21a0455d393f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:48.091428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:48.213586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258237f3-9cb0-4fb0-be9e-3c00bff36620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:48.214229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258237f3-9cb0-4fb0-be9e-3c00bff36620 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.214510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258237f3-9cb0-4fb0-be9e-3c00bff36620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.214784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258237f3-9cb0-4fb0-be9e-3c00bff36620 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.215471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258237f3-9cb0-4fb0-be9e-3c00bff36620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:48.217414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258237f3-9cb0-4fb0-be9e-3c00bff36620 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:48.261367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:48.285698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 757/1502] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:47 2022] POST /identity/v3/users => generated 290 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:48.294423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.294707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.295008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.302773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 746/1503] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:48.306737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:48.319761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:48.380887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:48.382025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:48.382293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9b73-da68-4af6-9577-9a6b352c3888 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:48.387471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17ddf1-c97c-43e7-8701-42d036f4fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:48.388218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ddf1-c97c-43e7-8701-42d036f4fd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.388487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ddf1-c97c-43e7-8701-42d036f4fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.388800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ddf1-c97c-43e7-8701-42d036f4fd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.389463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17ddf1-c97c-43e7-8701-42d036f4fd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:48.391104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17ddf1-c97c-43e7-8701-42d036f4fd65 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:48.419436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 758/1504] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:48.427704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:48.430708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:48.439840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 747/1505] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:48.442980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dcb85-7ebf-4614-810a-f57e0918b644 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.443269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dcb85-7ebf-4614-810a-f57e0918b644 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.443544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dcb85-7ebf-4614-810a-f57e0918b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.490701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-0d7dcb85-7ebf-4614-810a-f57e0918b644 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:48.495323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0d7dcb85-7ebf-4614-810a-f57e0918b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:48.521456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 748/1506] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:48.522561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dcb85-7ebf-4614-810a-f57e0918b644 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:48.544069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dcb85-7ebf-4614-810a-f57e0918b644 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:48.561382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:48.562372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.562795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.563354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.564485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:48.566782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:48.570852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:48.593369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1bf38-6ec4-4f30-8f77-a2238ed40c1a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:48.598373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 749/1507] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:48.598373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:48.603516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:48.606399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.607461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.608176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.626645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b737-b248-4ddb-a40e-75b8326d75e2 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:48.637084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:48.640972 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:48.641711 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:48.642806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.646255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.646784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.647939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:48.648321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:48.652452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:48.669362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 759/1508] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:48.670464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:48.673162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 750/1509] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:48.674235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:48.689948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91062a-f6d2-4094-b2b2-22f44db1870c service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:48.697186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4395c39-c04c-4d36-aeb6-bd22cd763cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:48.698106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395c39-c04c-4d36-aeb6-bd22cd763cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.698530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395c39-c04c-4d36-aeb6-bd22cd763cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.699059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395c39-c04c-4d36-aeb6-bd22cd763cf0 admin admin] PATH_INFO: `/v3/projects/f9c3f0506d6e4960b6a74f65ba5cb192/users/e87372c3e91e4e7e88a7fe7c76247fb5/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.702070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c54ed-c2d0-4437-9c6c-d0a43405808b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:48.717705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:48.718745 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.719062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.719423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.720074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:48.722309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4395c39-c04c-4d36-aeb6-bd22cd763cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c3f0506d6e4960b6a74f65ba5cb192, user_id=e87372c3e91e4e7e88a7fe7c76247fb5, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:48.724266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:48.727127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4395c39-c04c-4d36-aeb6-bd22cd763cf0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:48.758737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 760/1510] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:48 2022] PUT /identity/v3/projects/f9c3f0506d6e4960b6a74f65ba5cb192/users/e87372c3e91e4e7e88a7fe7c76247fb5/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:48.760958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a71d-62c6-4f70-b1bb-315effc0ebb4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:48.761397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a71d-62c6-4f70-b1bb-315effc0ebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:48.761727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a71d-62c6-4f70-b1bb-315effc0ebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:48.778912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 751/1511] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:48 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:48.780728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:48.828517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d808a71d-62c6-4f70-b1bb-315effc0ebb4 None None] MFA Rules not processed for user `e87372c3e91e4e7e88a7fe7c76247fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:48.832046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d808a71d-62c6-4f70-b1bb-315effc0ebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:48.993325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe810e-a175-4def-b105-1dcc859ec31f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.026432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.027078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.027360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.031125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.033088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.037401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.075668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 761/1512] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:49.079385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 752/1513] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:48 2022] POST /identity/v3/users => generated 287 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:49.080614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.080982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a71d-62c6-4f70-b1bb-315effc0ebb4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.095597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff611f-b381-4ad2-950d-95e112f68b67 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.103469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.104491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.104885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.105454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.106804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.112827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.123743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a71d-62c6-4f70-b1bb-315effc0ebb4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.129587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.130308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.130713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.131083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.131863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.133798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.151245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 762/1514] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:49.157764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.179908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfece6-252a-454c-aa7f-bb11001da1c8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.190765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.194273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.194918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.196848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.197944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.201887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.202360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 753/1515] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:49 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:49.206162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.230208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 763/1516] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:49.231343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.258512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab3e4-e6b5-4fbe-b3c4-122d7db4344a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.316931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:49.325119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c4410-61ea-49c9-9ba0-f720b7cc80d9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.331338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.335085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.335447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.339569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.340819 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.344953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.377778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e878933-82db-4846-a729-2d2a4112f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.378934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e878933-82db-4846-a729-2d2a4112f271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.379235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e878933-82db-4846-a729-2d2a4112f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.379727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e878933-82db-4846-a729-2d2a4112f271 admin admin] PATH_INFO: `/v3/projects/d0cedbce5e934d19b9499ddec03cf368/users/566b7c3d2729402ea76b9fb90c6f11bf/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.399365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 754/1517] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:49 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:27:49.400364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.417901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc6a71-5475-4baf-8116-6bfaeff5043f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.421940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e878933-82db-4846-a729-2d2a4112f271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cedbce5e934d19b9499ddec03cf368, user_id=566b7c3d2729402ea76b9fb90c6f11bf, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.425854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e878933-82db-4846-a729-2d2a4112f271 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.434243 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.435435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.435836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.436120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.436787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.438874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.452070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 764/1518] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:49 2022] PUT /identity/v3/projects/d0cedbce5e934d19b9499ddec03cf368/users/566b7c3d2729402ea76b9fb90c6f11bf/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:49.462448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.462762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.463527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.480412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 755/1519] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:49.481639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.519555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704dcc-0c2c-4b0e-b340-88a8dfc7739f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.537981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:49.575016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] MFA Rules not processed for user `566b7c3d2729402ea76b9fb90c6f11bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:49.577409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:49.669643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.670310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.670595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.671017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] PATH_INFO: `/v3/projects/3ae2f572e43641b292029f10fe31863e/users/fa3b273647084747b384d7dcfe8b5b25/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.707759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae2f572e43641b292029f10fe31863e, user_id=fa3b273647084747b384d7dcfe8b5b25, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.709111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 765/1520] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:49.709794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.711255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:49.715640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.727873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a6b1b-e87c-4ff8-9ea1-6199e078fdf8 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.733158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.733858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.734150 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.734845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] PATH_INFO: `/v3/users/80b6fd639a6543f199a11d5f61438fad` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.735871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b6fd639a6543f199a11d5f61438fad)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.737948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.740238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 756/1521] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:49 2022] PUT /identity/v3/projects/3ae2f572e43641b292029f10fe31863e/users/fa3b273647084747b384d7dcfe8b5b25/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:49.741590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.743872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:49.816893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b6fd639a6543f199a11d5f61438fad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:49.830842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b6fd639a6543f199a11d5f61438fad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:49.830842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b6fd639a6543f199a11d5f61438fad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:49.830842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b6fd639a6543f199a11d5f61438fad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:49.840282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b6fd639a6543f199a11d5f61438fad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:49.844486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f631d68-a383-4f00-89a9-732945d58d7c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.850874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.851662 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.852031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.852393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] PATH_INFO: `/v3/projects/fcd57b9f54d0451585b8db09b449e041` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.853835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd57b9f54d0451585b8db09b449e041)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.855953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:49.873267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 766/1522] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:49 2022] DELETE /identity/v3/users/80b6fd639a6543f199a11d5f61438fad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:49.877100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:49.879582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:49.912257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:49.978061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00f67a-9b1a-4824-896a-1dfcb4e49f75 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:49.985916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:49.986702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:49.987243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:49.987889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:49.988618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:49.991898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.026344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 767/1523] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:49 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:50.027992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.029950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.050985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd57b9f54d0451585b8db09b449e041', 'request_id': 'req-67bb1979-15eb-4e80-8157-5518668c235f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.062154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd57b9f54d0451585b8db09b449e041', 'request_id': 'req-67bb1979-15eb-4e80-8157-5518668c235f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.070909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd57b9f54d0451585b8db09b449e041', 'request_id': 'req-67bb1979-15eb-4e80-8157-5518668c235f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.086446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] The token cache is being invalidate because project fcd57b9f54d0451585b8db09b449e041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:50.086735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.087484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-67bb1979-15eb-4e80-8157-5518668c235f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.089573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 757/1524] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:49 2022] DELETE /identity/v3/projects/fcd57b9f54d0451585b8db09b449e041 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:50.092649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.092649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.092649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.109192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6c741-ea25-470c-9657-afa3086989aa admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.113588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:50.115357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.132077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:50.187074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.187710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.187988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.188258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.188909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.190575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.201070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 758/1525] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:50.202046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 768/1526] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:50.202512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.202913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.205587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.207959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.219603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7f597-2137-4317-a9d7-27591d0602bb None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.223571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380621a-18c7-464b-b669-7fe139c60282 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.225690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.226420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.226928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.227291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.228067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.230115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.230562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.231335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.231663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.231905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] PATH_INFO: `/v3/users/5d1551b3c320451f87a04d1f3f305689` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.233067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1551b3c320451f87a04d1f3f305689)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.235350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.261500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 759/1527] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:50 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:50.262624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.268309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.293306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acd8b9-cac8-4843-86cf-af39c4a6fd22 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.302965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.304068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:50.304659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.305449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.305898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] PATH_INFO: `/v3/projects/3ae2f572e43641b292029f10fe31863e/users/fa3b273647084747b384d7dcfe8b5b25/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.306557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1551b3c320451f87a04d1f3f305689'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.308167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae2f572e43641b292029f10fe31863e, user_id=fa3b273647084747b384d7dcfe8b5b25, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.312701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.319785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1551b3c320451f87a04d1f3f305689'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.328666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1551b3c320451f87a04d1f3f305689'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.328875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 760/1528] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:50 2022] PUT /identity/v3/projects/3ae2f572e43641b292029f10fe31863e/users/fa3b273647084747b384d7dcfe8b5b25/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:50.329789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1551b3c320451f87a04d1f3f305689'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.329902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.331857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.350014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1551b3c320451f87a04d1f3f305689'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:50.382566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 769/1529] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:50 2022] DELETE /identity/v3/users/5d1551b3c320451f87a04d1f3f305689 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:50.383914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.394285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.421291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f838e9-7462-446a-9b23-9078ba3e1931 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.502079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad3aa9-fb91-4418-aa16-356d568e0fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.502998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad3aa9-fb91-4418-aa16-356d568e0fce service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.503285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad3aa9-fb91-4418-aa16-356d568e0fce service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.503595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad3aa9-fb91-4418-aa16-356d568e0fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.510559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5dad3aa9-fb91-4418-aa16-356d568e0fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.516008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fe810-4d99-47b6-a154-fe0be1d4507c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.521883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.523080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.523369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.523649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.524585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.524940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad3aa9-fb91-4418-aa16-356d568e0fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.526451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.526674 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad3aa9-fb91-4418-aa16-356d568e0fce service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.541139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 761/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:50.542938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.543325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.543605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.543749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 770/1531] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:50.545331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.560042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a993e3-0e25-467f-956f-3b062f5a63ce admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.567862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.568884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.569310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.569720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] PATH_INFO: `/v3/projects/77334b834233473ea4a1cbbb41bb0ae9/users/52ed5975fdac40a48d9fbd14f977ab5f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.591863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77334b834233473ea4a1cbbb41bb0ae9, user_id=52ed5975fdac40a48d9fbd14f977ab5f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.592340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] MFA Rules not processed for user `fa3b273647084747b384d7dcfe8b5b25`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:50.595907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.598346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.640113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 771/1532] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:50 2022] PUT /identity/v3/projects/77334b834233473ea4a1cbbb41bb0ae9/users/52ed5975fdac40a48d9fbd14f977ab5f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:50.651279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.731055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:50.762884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627295f-0afd-4d40-a07f-935b132d32a6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.768861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.769845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.770152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.770475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.772011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.773681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.789242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 772/1533] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:50.794746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.817577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 762/1534] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:50.826681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d8dea-3169-49d3-89b1-3f568fd0eeaa admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:50.832900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c4cc9-fd0b-4508-adcc-ba957d7e6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:50.833590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4cc9-fd0b-4508-adcc-ba957d7e6aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.833870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4cc9-fd0b-4508-adcc-ba957d7e6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.834216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4cc9-fd0b-4508-adcc-ba957d7e6aff admin admin] PATH_INFO: `/v3/projects/77334b834233473ea4a1cbbb41bb0ae9/users/52ed5975fdac40a48d9fbd14f977ab5f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.836874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c4cc9-fd0b-4508-adcc-ba957d7e6aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=77334b834233473ea4a1cbbb41bb0ae9, user_id=52ed5975fdac40a48d9fbd14f977ab5f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:50.839014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:50.840723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.849498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c4cc9-fd0b-4508-adcc-ba957d7e6aff admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:50.884041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 773/1535] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:50 2022] PUT /identity/v3/projects/77334b834233473ea4a1cbbb41bb0ae9/users/52ed5975fdac40a48d9fbd14f977ab5f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:50.896968 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:50.897449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:50.904397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:50.937907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] MFA Rules not processed for user `52ed5975fdac40a48d9fbd14f977ab5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:50.939380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:50.944944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:51.013725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c173c1-e333-44c8-b785-ff001e4c1cbf None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:51.094626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 774/1536] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:51.102877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:51.104316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.195058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:51.196309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.196755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.197097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.240242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda69e4-3b35-410f-82aa-5ec41f409c0a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:51.252063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:51.253202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.253494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.253748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] PATH_INFO: `/v3/projects/94c44c793aac4c2a91f7b5a73266e3b4` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.256268 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c44c793aac4c2a91f7b5a73266e3b4)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:51.258253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:51.373553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c44c793aac4c2a91f7b5a73266e3b4', 'request_id': 'req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.380031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:51.384496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:51.402143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c44c793aac4c2a91f7b5a73266e3b4', 'request_id': 'req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.420899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c44c793aac4c2a91f7b5a73266e3b4', 'request_id': 'req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.422248 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 763/1537] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:27:51.423412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:51.427645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.447463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] The token cache is being invalidate because project 94c44c793aac4c2a91f7b5a73266e3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:51.447810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.449506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.452326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 775/1538] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:51 2022] DELETE /identity/v3/projects/94c44c793aac4c2a91f7b5a73266e3b4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:51.453396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:51.458954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.473545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6290e67-29df-4afc-bf9e-88abab585ca8 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:51.526327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:51.546271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:51.559785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a7356-ad2e-415c-a2ce-331d78f1bf45 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:51.564499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7edf-31b7-40f3-b81f-49c665b38bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:51.565611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7edf-31b7-40f3-b81f-49c665b38bdb service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.566062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7edf-31b7-40f3-b81f-49c665b38bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.566400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7edf-31b7-40f3-b81f-49c665b38bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.568299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bece7edf-31b7-40f3-b81f-49c665b38bdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.577989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:51.577989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.577989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.577989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] PATH_INFO: `/v3/projects/1d23e2c5c19a4d82807725e144657522` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.582239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d23e2c5c19a4d82807725e144657522)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:51.585904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:51.647949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7edf-31b7-40f3-b81f-49c665b38bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:51.650027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7edf-31b7-40f3-b81f-49c665b38bdb service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:51.655687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d23e2c5c19a4d82807725e144657522', 'request_id': 'req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.662351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 776/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:51.663949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de84f-5547-4478-8888-242653513be1 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.664375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de84f-5547-4478-8888-242653513be1 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.664476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de84f-5547-4478-8888-242653513be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.669751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d23e2c5c19a4d82807725e144657522', 'request_id': 'req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.678950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d23e2c5c19a4d82807725e144657522', 'request_id': 'req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.697100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6f9de84f-5547-4478-8888-242653513be1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:51.699299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6f9de84f-5547-4478-8888-242653513be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.704269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] The token cache is being invalidate because project 1d23e2c5c19a4d82807725e144657522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:51.705342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.706567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.708446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 764/1540] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:51 2022] DELETE /identity/v3/projects/1d23e2c5c19a4d82807725e144657522 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:51.714273 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:51.716762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.798007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 777/1541] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:51.807561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2cb04-dfad-4bd1-8739-126b8aa96341 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.807906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2cb04-dfad-4bd1-8739-126b8aa96341 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.808301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2cb04-dfad-4bd1-8739-126b8aa96341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.831211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2dd4-8bef-4f1a-8b78-1e918ccbd7ae admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:51.838463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:51.839444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.839934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.840543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] PATH_INFO: `/v3/users/2ffb9ed6636b4f00b3c21a0455d393f2` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.841832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffb9ed6636b4f00b3c21a0455d393f2)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:51.844373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:51.850597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6ac2cb04-dfad-4bd1-8739-126b8aa96341 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:51.851895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6ac2cb04-dfad-4bd1-8739-126b8aa96341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.861092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 778/1542] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:51.866878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2cb04-dfad-4bd1-8739-126b8aa96341 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:51.892153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2cb04-dfad-4bd1-8739-126b8aa96341 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:51.903858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:51.906411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:51.907163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:51.907961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:51.909672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:51.911389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:51.917595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:51.950921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 779/1543] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:51.952070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:51.954958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffb9ed6636b4f00b3c21a0455d393f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.958970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:51.968088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffb9ed6636b4f00b3c21a0455d393f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.968735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffb9ed6636b4f00b3c21a0455d393f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.969527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffb9ed6636b4f00b3c21a0455d393f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.984712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffb9ed6636b4f00b3c21a0455d393f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:51.992973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:52.033936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 765/1544] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:51 2022] DELETE /identity/v3/users/2ffb9ed6636b4f00b3c21a0455d393f2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:52.033936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.034787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:52.074755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b654-d368-4e33-aa0f-0606e0c6f230 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.084137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:52.195447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff70367-1218-44c8-aa65-b69a5fdda006 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.200832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.201587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.201930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.202125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.203465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.205550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.224782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3b273647084747b384d7dcfe8b5b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae2f572e43641b292029f10fe31863e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.226068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.226393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.226720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.227580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:52.227920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.229912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.251518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 780/1545] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:52.257509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.260723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:52.262790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 766/1546] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:52 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:52.270217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.297670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826321b8-0921-4981-a411-f7d486d8decf tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.396807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3b273647084747b384d7dcfe8b5b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae2f572e43641b292029f10fe31863e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.397762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.398043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.398345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.408040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.410572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.421043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88238498-7a71-44d7-a6e6-d82396d0faae admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.435757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.439046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.441186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.441677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.442546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.448497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.474037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 781/1547] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:52 2022] POST /identity/v3/projects => generated 354 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:52.478306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.484119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 767/1548] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:52 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:52.485434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:52.485832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.514115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307373-1a77-4471-bbdd-36110b10341e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.621537 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f5592-e34f-41d0-8865-52a8b10144fb tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.627537 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.628353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.628660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.629074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] PATH_INFO: `/v3/users/566b7c3d2729402ea76b9fb90c6f11bf` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.630453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=566b7c3d2729402ea76b9fb90c6f11bf)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.632675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.640435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3b273647084747b384d7dcfe8b5b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae2f572e43641b292029f10fe31863e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.641888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.642340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.642769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.643996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:52.644423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.646307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.654735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:52.664997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 768/1549] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:52.664997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.685777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88613-4df8-484e-a5e0-75fbf825e831 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.695286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.695564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.695857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.696130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.696957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.698635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.701194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:52.715863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 769/1550] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:52.716638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.718396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:52.719282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566b7c3d2729402ea76b9fb90c6f11bf'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.728556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566b7c3d2729402ea76b9fb90c6f11bf'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.729263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566b7c3d2729402ea76b9fb90c6f11bf'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.729890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566b7c3d2729402ea76b9fb90c6f11bf'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.731934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80b53-2aa8-41b8-9c55-11f24b2ea7e4 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.737729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566b7c3d2729402ea76b9fb90c6f11bf'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.738369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.739068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.739341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.739602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] PATH_INFO: `/v3/projects/e0b75d55812e4614a33c405e99bbfcf3` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.740830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b75d55812e4614a33c405e99bbfcf3)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.742714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.757490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 782/1551] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:52 2022] DELETE /identity/v3/users/566b7c3d2729402ea76b9fb90c6f11bf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:52.757490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.758650 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:52.793789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b75d55812e4614a33c405e99bbfcf3', 'request_id': 'req-2ada5731-ba4e-4d29-875b-850ac71e96ca'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.803218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b75d55812e4614a33c405e99bbfcf3', 'request_id': 'req-2ada5731-ba4e-4d29-875b-850ac71e96ca'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.811228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b75d55812e4614a33c405e99bbfcf3', 'request_id': 'req-2ada5731-ba4e-4d29-875b-850ac71e96ca'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.822176 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] The token cache is being invalidate because project e0b75d55812e4614a33c405e99bbfcf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:52.822581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.823346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.824909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 770/1552] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:52 2022] DELETE /identity/v3/projects/e0b75d55812e4614a33c405e99bbfcf3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:52.825800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:52.827129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:52.831405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba90922-d0e2-4372-85d1-31b139940517 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.885854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3b273647084747b384d7dcfe8b5b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae2f572e43641b292029f10fe31863e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.886521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.886800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.887097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] PATH_INFO: `/v3/projects/f61e64d49ee54bca94a71e4622bff409` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.888262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f61e64d49ee54bca94a71e4622bff409)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.890177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.890355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5731-ba4e-4d29-875b-850ac71e96ca admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:52.896701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279222b7-4738-427f-ad04-d2d893291d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:52.897319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279222b7-4738-427f-ad04-d2d893291d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.897599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279222b7-4738-427f-ad04-d2d893291d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.897870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279222b7-4738-427f-ad04-d2d893291d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.898515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279222b7-4738-427f-ad04-d2d893291d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:52.900133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279222b7-4738-427f-ad04-d2d893291d1e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:52.911218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 771/1553] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:52.912418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.912700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.912969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.934275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:52.935524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:52.939800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61e64d49ee54bca94a71e4622bff409', 'request_id': 'req-b3a99911-716e-4492-9419-da01221a8c43'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.948930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61e64d49ee54bca94a71e4622bff409', 'request_id': 'req-b3a99911-716e-4492-9419-da01221a8c43'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.950305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:52.957875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61e64d49ee54bca94a71e4622bff409', 'request_id': 'req-b3a99911-716e-4492-9419-da01221a8c43'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.970777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] The token cache is being invalidate because project f61e64d49ee54bca94a71e4622bff409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:52.971339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.972374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b3a99911-716e-4492-9419-da01221a8c43 tempest-VolumeQuotaClassesTest-1052602401 tempest-VolumeQuotaClassesTest-1052602401-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:52.974213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 783/1554] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:52 2022] DELETE /identity/v3/projects/f61e64d49ee54bca94a71e4622bff409 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:52.975435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd666cea-8166-4865-bf9b-af42bb7e95d0 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:52.975718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd666cea-8166-4865-bf9b-af42bb7e95d0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:52.975974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd666cea-8166-4865-bf9b-af42bb7e95d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:52.996640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-cd666cea-8166-4865-bf9b-af42bb7e95d0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:52.997860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cd666cea-8166-4865-bf9b-af42bb7e95d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.004876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 772/1555] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:53.007701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.008401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 784/1556] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:53.011716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.016043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.016319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.016587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.029958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a932ae8-9837-40e5-a0ab-69a35c7a588d None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.035701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.036369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.036811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.037290 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] PATH_INFO: `/v3/projects/98d211cc4cee4da4b03c5e061580b27f/users/451189400cf1476f94386d1ea760d823/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.038388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:53.039685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.040377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:53.050596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 785/1557] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:53.052123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.054095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.058975 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d211cc4cee4da4b03c5e061580b27f, user_id=451189400cf1476f94386d1ea760d823, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.062261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.075903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 773/1558] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:53 2022] PUT /identity/v3/projects/98d211cc4cee4da4b03c5e061580b27f/users/451189400cf1476f94386d1ea760d823/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:53.076559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.129798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9890d-38fa-4333-b66b-c4a104b7b8a5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.167504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc73d3-4061-4478-b310-3db92c428986 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.172639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8f49-1bef-4328-a7ea-86f7f15dbef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.173382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8f49-1bef-4328-a7ea-86f7f15dbef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.173713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8f49-1bef-4328-a7ea-86f7f15dbef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.174076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8f49-1bef-4328-a7ea-86f7f15dbef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.174886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8f49-1bef-4328-a7ea-86f7f15dbef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:53.175306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8f49-1bef-4328-a7ea-86f7f15dbef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.176974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8f49-1bef-4328-a7ea-86f7f15dbef4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.189398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 774/1559] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:53.191023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd6640-5d7b-4f57-862a-19f7a4c73a8b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.191402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd6640-5d7b-4f57-862a-19f7a4c73a8b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.191764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd6640-5d7b-4f57-862a-19f7a4c73a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.219841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.220709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.223222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.223600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.233320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.234893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.235740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-c7fd6640-5d7b-4f57-862a-19f7a4c73a8b None None] MFA Rules not processed for user `451189400cf1476f94386d1ea760d823`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:53.237080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c7fd6640-5d7b-4f57-862a-19f7a4c73a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.246375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 786/1560] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:53.247315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.257022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3466cb-4d1e-4dd4-8e38-c6ef825eb24c service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.261887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.262538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.263000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.263260 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.264172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.265864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.299667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 787/1561] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:53 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:53.299667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.305156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.310577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 775/1562] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:53.311726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd6640-5d7b-4f57-862a-19f7a4c73a8b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.327753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd6640-5d7b-4f57-862a-19f7a4c73a8b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.390700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad920174-6693-402b-b5ae-1e8dfdbd203a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.393315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.393976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.394722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.395038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.395682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.395780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.396416 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.396691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.396955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] PATH_INFO: `/v3/users/e87372c3e91e4e7e88a7fe7c76247fb5` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.397770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.398135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87372c3e91e4e7e88a7fe7c76247fb5)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.400628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.412208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:53.413785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:53.436949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 776/1563] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:53 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:53.439071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.442003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.473746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87372c3e91e4e7e88a7fe7c76247fb5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.481511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87372c3e91e4e7e88a7fe7c76247fb5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.482418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87372c3e91e4e7e88a7fe7c76247fb5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.483255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87372c3e91e4e7e88a7fe7c76247fb5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.493852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87372c3e91e4e7e88a7fe7c76247fb5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.514663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 788/1564] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:53 2022] DELETE /identity/v3/users/e87372c3e91e4e7e88a7fe7c76247fb5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:53.516450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.519001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.560035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55299f4-ce46-49a1-955b-c93026b6ba0f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.596310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef00cda-7c36-4592-b61d-2a62c41eae23 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.603118 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc211-d0b3-4b7d-904e-530a62fad03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.605512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc211-d0b3-4b7d-904e-530a62fad03b admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.605795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc211-d0b3-4b7d-904e-530a62fad03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.607136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc211-d0b3-4b7d-904e-530a62fad03b admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.607878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc211-d0b3-4b7d-904e-530a62fad03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.610553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc211-d0b3-4b7d-904e-530a62fad03b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.622900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.623554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.623988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.624266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.626284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.637870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 789/1565] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:53.639716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.640222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.640661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.673851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:53.675521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.685034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 790/1566] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:53.685979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.687550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.700911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840eccb-f3f2-485d-be8c-320de3b5e135 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.705774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.706437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.706735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.707206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] PATH_INFO: `/v3/projects/d0cedbce5e934d19b9499ddec03cf368` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.708320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cedbce5e934d19b9499ddec03cf368)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.710255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.716392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.717998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.737456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 777/1567] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:53.738641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.761483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d085b5-66ae-47b1-a5b1-5241e2b86d59 service glance] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.769800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.770424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.770702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.771032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.771636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.773546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.789967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cedbce5e934d19b9499ddec03cf368', 'request_id': 'req-90e8f409-052d-4b57-a933-7c16a25deba9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.790169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 778/1568] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:53.791228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.793649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.801693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cedbce5e934d19b9499ddec03cf368', 'request_id': 'req-90e8f409-052d-4b57-a933-7c16a25deba9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.811637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cedbce5e934d19b9499ddec03cf368', 'request_id': 'req-90e8f409-052d-4b57-a933-7c16a25deba9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.832738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:53.834359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] The token cache is being invalidate because project d0cedbce5e934d19b9499ddec03cf368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:53.834682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.835469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:53.837334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 791/1569] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:53 2022] DELETE /identity/v3/projects/d0cedbce5e934d19b9499ddec03cf368 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:53.838202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.841768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.875366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:53.899019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098146d-4317-44c1-a884-8cd92be8f2f7 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.916223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8f409-052d-4b57-a933-7c16a25deba9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:53.921328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.922113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.922395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.922665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] PATH_INFO: `/v3/projects/bc08a89d5eb441b08c637847eb2e6049/users/d9e1a864441348ad82ddda09b1ac358a/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.938958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08a89d5eb441b08c637847eb2e6049, user_id=d9e1a864441348ad82ddda09b1ac358a, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.941948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.962866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 792/1570] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:53 2022] PUT /identity/v3/projects/bc08a89d5eb441b08c637847eb2e6049/users/d9e1a864441348ad82ddda09b1ac358a/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:53.962866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:53.962866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.963989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5103d85-0f17-46e0-a33a-cf06d370e7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:53.964987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103d85-0f17-46e0-a33a-cf06d370e7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.965416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103d85-0f17-46e0-a33a-cf06d370e7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.965857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103d85-0f17-46e0-a33a-cf06d370e7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:53.968140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b5103d85-0f17-46e0-a33a-cf06d370e7f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:53.982024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5103d85-0f17-46e0-a33a-cf06d370e7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:53.983554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5103d85-0f17-46e0-a33a-cf06d370e7f5 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:53.996162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 779/1571] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:53.997788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:53.998301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:53.998594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:54.060468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] MFA Rules not processed for user `d9e1a864441348ad82ddda09b1ac358a`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:54.062016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:54.110930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320961d-e566-4ebd-8ff9-5cebfe8a48af admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:54.128480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:54.129552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:54.129838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:54.130139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] PATH_INFO: `/v3/users/52ed5975fdac40a48d9fbd14f977ab5f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:54.133823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ed5975fdac40a48d9fbd14f977ab5f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:54.145449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:54.167506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 780/1572] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:54.179104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:54.180657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:54.266905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ed5975fdac40a48d9fbd14f977ab5f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.296245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ed5975fdac40a48d9fbd14f977ab5f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.297018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ed5975fdac40a48d9fbd14f977ab5f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.297639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ed5975fdac40a48d9fbd14f977ab5f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.308184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bb754-3760-455f-bbba-9d6845c1d8b6 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:54.312095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ed5975fdac40a48d9fbd14f977ab5f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.317109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124459b-694e-4458-b56b-eabf48626939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:54.317742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124459b-694e-4458-b56b-eabf48626939 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:54.318014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124459b-694e-4458-b56b-eabf48626939 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:54.318274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124459b-694e-4458-b56b-eabf48626939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:54.325239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c124459b-694e-4458-b56b-eabf48626939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:54.349320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 793/1573] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:53 2022] DELETE /identity/v3/users/52ed5975fdac40a48d9fbd14f977ab5f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:54.350366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124459b-694e-4458-b56b-eabf48626939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:54.351856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124459b-694e-4458-b56b-eabf48626939 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:54.364518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 781/1574] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:27:54.394763 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:54.396252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:54.401970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:54.547652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ea83-6380-4acc-a2ee-c88ae697f674 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:54.553514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:54.554584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:54.555027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:54.555395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] PATH_INFO: `/v3/users/d9e1a864441348ad82ddda09b1ac358a` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:54.556692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e1a864441348ad82ddda09b1ac358a)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:54.558952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:54.640666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e1a864441348ad82ddda09b1ac358a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.651529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e1a864441348ad82ddda09b1ac358a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.652317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e1a864441348ad82ddda09b1ac358a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.652938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e1a864441348ad82ddda09b1ac358a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.662553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e1a864441348ad82ddda09b1ac358a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:54.693676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 794/1575] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:54 2022] DELETE /identity/v3/users/d9e1a864441348ad82ddda09b1ac358a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:54.695442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:54.695892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:54.696100 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:54.719866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:54.720850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:54.748036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:54.773156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:54.774719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:54.916904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 782/1576] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:54.935875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb196-2d83-45a0-ae17-cf92bccadd4e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:54.941545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:54.942303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:54.942727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:54.943304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] PATH_INFO: `/v3/projects/77334b834233473ea4a1cbbb41bb0ae9` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:54.944336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77334b834233473ea4a1cbbb41bb0ae9)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:54.946348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:54.987570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:55.025787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:55.030965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.039388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77334b834233473ea4a1cbbb41bb0ae9', 'request_id': 'req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.079117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77334b834233473ea4a1cbbb41bb0ae9', 'request_id': 'req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.095562 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77334b834233473ea4a1cbbb41bb0ae9', 'request_id': 'req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.115628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] The token cache is being invalidate because project 77334b834233473ea4a1cbbb41bb0ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:55.115913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.116642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-112d6806-4f9f-4cc7-ae7d-22fe974b78b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.118355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 795/1577] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:54 2022] DELETE /identity/v3/projects/77334b834233473ea4a1cbbb41bb0ae9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:55.124234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.124563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.124840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.168504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:55.172410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.235252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5656d6-27d1-4b8d-bdca-470af930979b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:55.311222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 796/1578] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:55.311222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:55.311222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.329613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc78bc-b07c-4504-a648-81deb6761f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:55.330558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc78bc-b07c-4504-a648-81deb6761f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.331578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc78bc-b07c-4504-a648-81deb6761f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.331851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc78bc-b07c-4504-a648-81deb6761f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.333764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f7cc78bc-b07c-4504-a648-81deb6761f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.339734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ef9a5-0509-4599-9ca8-f9203416e258 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:55.354166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc78bc-b07c-4504-a648-81deb6761f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:55.355859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc78bc-b07c-4504-a648-81deb6761f58 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:55.359318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:55.360188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.361494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.362307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] PATH_INFO: `/v3/projects/f9c3f0506d6e4960b6a74f65ba5cb192` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.363758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c3f0506d6e4960b6a74f65ba5cb192)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:55.366243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:55.368883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 783/1579] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:27:55.370416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da01e0-4950-4028-8b61-8b2ba2c93ac9 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.371142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da01e0-4950-4028-8b61-8b2ba2c93ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.371142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da01e0-4950-4028-8b61-8b2ba2c93ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.396977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-88da01e0-4950-4028-8b61-8b2ba2c93ac9 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:55.398477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-88da01e0-4950-4028-8b61-8b2ba2c93ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.412643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 784/1580] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:55.413937 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da01e0-4950-4028-8b61-8b2ba2c93ac9 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:55.427307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da01e0-4950-4028-8b61-8b2ba2c93ac9 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:55.444188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c3f0506d6e4960b6a74f65ba5cb192', 'request_id': 'req-9108639c-5260-48b0-b8bb-0475c8ffded7'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.454223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c3f0506d6e4960b6a74f65ba5cb192', 'request_id': 'req-9108639c-5260-48b0-b8bb-0475c8ffded7'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.462738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c3f0506d6e4960b6a74f65ba5cb192', 'request_id': 'req-9108639c-5260-48b0-b8bb-0475c8ffded7'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.478046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] The token cache is being invalidate because project f9c3f0506d6e4960b6a74f65ba5cb192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:55.478343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.480023 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.482408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 797/1581] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:55 2022] DELETE /identity/v3/projects/f9c3f0506d6e4960b6a74f65ba5cb192 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:55.487982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:55.490414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.503632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:55.504495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.504780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.505305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.506180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:55.506475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:55.509437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:55.527057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 785/1582] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:55.566135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:55.575897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:55.576125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.612475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fd5e-5b61-416a-a226-af8f075a860a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:55.642285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:55.642285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.642285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.642285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.642845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:55.642845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:55.651511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108639c-5260-48b0-b8bb-0475c8ffded7 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:55.673558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:55.673970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.674316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.674605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] PATH_INFO: `/v3/users/fa3b273647084747b384d7dcfe8b5b25` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.676225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:55.677331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3b273647084747b384d7dcfe8b5b25)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:55.679391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:55.721514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 786/1583] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:55 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:55.723232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:55.819420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3b273647084747b384d7dcfe8b5b25'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.848272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390714-3603-4735-b772-8dfdeec6beee admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:55.851888 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3b273647084747b384d7dcfe8b5b25'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.854434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:55.854714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3b273647084747b384d7dcfe8b5b25'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.855199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:55.855476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:55.855774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:55.856210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3b273647084747b384d7dcfe8b5b25'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.856701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:55.859088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:55.886552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3b273647084747b384d7dcfe8b5b25'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:55.900572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 787/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:55 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:55.903836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:55.908162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:55.931324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 798/1585] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:27:55 2022] DELETE /identity/v3/users/fa3b273647084747b384d7dcfe8b5b25 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:55.948032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99115-8501-43da-a87d-7fe7e9a87a58 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.060634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.061346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.061612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.061885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.062548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.064205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.089280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 788/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:56.093077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.104960 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f04ec-524a-4eca-9d62-78f48979aa1d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.109902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588b475-953e-4bfa-8737-3eadd1b311c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.110521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b475-953e-4bfa-8737-3eadd1b311c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.110797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b475-953e-4bfa-8737-3eadd1b311c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.111111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b475-953e-4bfa-8737-3eadd1b311c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.111985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588b475-953e-4bfa-8737-3eadd1b311c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.113703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588b475-953e-4bfa-8737-3eadd1b311c8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.124694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 799/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:27:56.129269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.140360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2cf6-fc73-496b-a2de-d6c0c40b5521 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.146073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.146971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.147250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.147521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] PATH_INFO: `/v3/projects/0646d9156a004ba7a70e889f7c32545e/users/4e59dceaa88644be934a7c7bb103ac01/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.171229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0646d9156a004ba7a70e889f7c32545e, user_id=4e59dceaa88644be934a7c7bb103ac01, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.174260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.187637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 789/1588] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:56 2022] PUT /identity/v3/projects/0646d9156a004ba7a70e889f7c32545e/users/4e59dceaa88644be934a7c7bb103ac01/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:56.199062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441501c4-7621-4d2c-841c-aec4912b8946 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.199062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441501c4-7621-4d2c-841c-aec4912b8946 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.199062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441501c4-7621-4d2c-841c-aec4912b8946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.199946 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.201810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:56.243352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-441501c4-7621-4d2c-841c-aec4912b8946 None None] MFA Rules not processed for user `4e59dceaa88644be934a7c7bb103ac01`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:56.244678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-441501c4-7621-4d2c-841c-aec4912b8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:56.276956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:56.310488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03203180-8811-40b4-acad-c3f0427c7ad7 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.317732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.318732 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.319363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.319831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] PATH_INFO: `/v3/projects/bc08a89d5eb441b08c637847eb2e6049` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.321466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc08a89d5eb441b08c637847eb2e6049)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.323876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.399465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 800/1589] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:56.412213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441501c4-7621-4d2c-841c-aec4912b8946 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.434355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc08a89d5eb441b08c637847eb2e6049', 'request_id': 'req-9d237644-0364-4a44-8155-dca3c9874fbb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:56.445862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441501c4-7621-4d2c-841c-aec4912b8946 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.446370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc08a89d5eb441b08c637847eb2e6049', 'request_id': 'req-9d237644-0364-4a44-8155-dca3c9874fbb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:56.470636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc08a89d5eb441b08c637847eb2e6049', 'request_id': 'req-9d237644-0364-4a44-8155-dca3c9874fbb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:56.493820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:56.515467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] The token cache is being invalidate because project bc08a89d5eb441b08c637847eb2e6049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:56.515757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:56.519187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9d237644-0364-4a44-8155-dca3c9874fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:56.524259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 790/1590] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:56 2022] DELETE /identity/v3/projects/bc08a89d5eb441b08c637847eb2e6049 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:56.529850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e9c3-56a5-4d36-8e3d-c6b994941b7a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.530315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e9c3-56a5-4d36-8e3d-c6b994941b7a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.530531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e9c3-56a5-4d36-8e3d-c6b994941b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.537226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.538146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.538567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.539275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.540167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.542804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.583590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-c676e9c3-56a5-4d36-8e3d-c6b994941b7a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:56.584845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c676e9c3-56a5-4d36-8e3d-c6b994941b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:56.586101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 801/1591] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:56 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:56.589992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.593123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:56.809647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7619e16-4993-4a57-98b1-cb4ad50714ad admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.821762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 791/1592] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:56.830553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.830553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.830553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.830553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.830973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.830973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.831809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ce146-52fb-48ac-a933-bbfbcf3725f2 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.832092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ce146-52fb-48ac-a933-bbfbcf3725f2 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.833335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ce146-52fb-48ac-a933-bbfbcf3725f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.910802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 802/1593] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:56 2022] POST /identity/v3/users => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:56.912520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8f1ce146-52fb-48ac-a933-bbfbcf3725f2 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:56.913947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8f1ce146-52fb-48ac-a933-bbfbcf3725f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:56.915105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.929720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78fa0-824a-46d2-ad97-f9ba16a1853f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.938437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 792/1594] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:27:56.939971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ce146-52fb-48ac-a933-bbfbcf3725f2 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.942400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.943412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.943902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.944398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.945558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.948349 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.961853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ce146-52fb-48ac-a933-bbfbcf3725f2 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.964730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 803/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:56.970171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:56.977570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:56.978355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:56.979021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:56.979021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:56.979590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:56.979895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:56.983450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:56.986186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b64d2a-e323-4913-9851-9dffd68c0fe7 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:56.992735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.006949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.006949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.006949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] PATH_INFO: `/v3/projects/808e22c54b224cf48d41adfb19a70a12/users/3b7e1820ebfb4f47945b45cf006b7aa0/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.016455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 793/1596] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:57.021115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.039906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808e22c54b224cf48d41adfb19a70a12, user_id=3b7e1820ebfb4f47945b45cf006b7aa0, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.044815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8036-68fb-491b-ae45-dbdcb632a2c0 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.050504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.059405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.060185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.060488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.060867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.061477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.063705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.088571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 804/1597] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:56 2022] PUT /identity/v3/projects/808e22c54b224cf48d41adfb19a70a12/users/3b7e1820ebfb4f47945b45cf006b7aa0/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:57.088571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.116352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 794/1598] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:57 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:57.121130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.181211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:57.210046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14f21f-89be-47a8-8ea8-672945ed4774 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.230702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1c955-1237-415d-867e-21f5940a59a2 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.233483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:57.237103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.238066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.238443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.238803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.240703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.242716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.270853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 795/1599] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:57 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:57.274682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.284620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c56847-cd9b-45d8-8aef-46e50ea9cc79 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.289474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.290087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.290365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.290634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.291341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.291462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.291972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.292561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.292840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.293258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.293485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.295442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.304741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 796/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:27:57.308720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.312904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 805/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:57.316925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.328160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab7ba-737f-47a5-8709-31aafa323eca admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.333154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffac00b-2c95-49a9-988f-04d67c50c432 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.337896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.338710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.339098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.339358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.339811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16baba9-450a-4d53-b254-5292e777076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.340433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.342870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.347330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16baba9-450a-4d53-b254-5292e777076b admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.347780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16baba9-450a-4d53-b254-5292e777076b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.348154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16baba9-450a-4d53-b254-5292e777076b admin admin] PATH_INFO: `/v3/projects/808e22c54b224cf48d41adfb19a70a12/users/3b7e1820ebfb4f47945b45cf006b7aa0/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.350439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16baba9-450a-4d53-b254-5292e777076b admin admin] RBAC: Authorizing `identity:create_grant(project_id=808e22c54b224cf48d41adfb19a70a12, user_id=3b7e1820ebfb4f47945b45cf006b7aa0, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.353286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16baba9-450a-4d53-b254-5292e777076b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.358775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 797/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:27:57.359296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.365767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 806/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:57 2022] PUT /identity/v3/projects/808e22c54b224cf48d41adfb19a70a12/users/3b7e1820ebfb4f47945b45cf006b7aa0/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:57.373393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad5c1-2d05-46ea-a489-80a57859e3ce admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.376199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7995d94-5509-4eca-a40a-b5b43be2d15c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.376558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7995d94-5509-4eca-a40a-b5b43be2d15c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.376910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7995d94-5509-4eca-a40a-b5b43be2d15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.414183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f7995d94-5509-4eca-a40a-b5b43be2d15c None None] MFA Rules not processed for user `3b7e1820ebfb4f47945b45cf006b7aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:57.415892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f7995d94-5509-4eca-a40a-b5b43be2d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:57.463897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.463897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.464359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.464642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] PATH_INFO: `/v3/projects/b92eb631563a4dc185111d27510f38ea/users/8d48d31d862a4ac6a79ea8daec54da29/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.499954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92eb631563a4dc185111d27510f38ea, user_id=8d48d31d862a4ac6a79ea8daec54da29, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.503378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.536074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 798/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:57 2022] PUT /identity/v3/projects/b92eb631563a4dc185111d27510f38ea/users/8d48d31d862a4ac6a79ea8daec54da29/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:57.536074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.536379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:57.599384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 807/1605] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:57.601437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.601437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.601627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.637767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] MFA Rules not processed for user `8d48d31d862a4ac6a79ea8daec54da29`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:57.659823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:57.675370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a604ce-abdd-4134-88fa-808ccee3ca64 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.682445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.683135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.683453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.683750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] PATH_INFO: `/v3/projects/3ae2f572e43641b292029f10fe31863e` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.685729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae2f572e43641b292029f10fe31863e)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:57.687999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:57.762147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 808/1606] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:57.763253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.764811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:57.771901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:57.800199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae2f572e43641b292029f10fe31863e', 'request_id': 'req-d064623b-23b9-4fd2-82d8-a12e1c99ae88'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:57.816742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:57.820792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae2f572e43641b292029f10fe31863e', 'request_id': 'req-d064623b-23b9-4fd2-82d8-a12e1c99ae88'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:57.838961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae2f572e43641b292029f10fe31863e', 'request_id': 'req-d064623b-23b9-4fd2-82d8-a12e1c99ae88'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:57.852349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] The token cache is being invalidate because project 3ae2f572e43641b292029f10fe31863e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:27:57.852715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:57.853757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:27:57.854900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 799/1607] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:27:57 2022] DELETE /identity/v3/projects/3ae2f572e43641b292029f10fe31863e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:57.855923 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:57.857706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:57.905186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d8191-2b39-43a3-bd87-b9f1a66d1a4b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:57.990916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbfc92-c4b0-44aa-ad14-9d1d12b0a8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:57.991869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbfc92-c4b0-44aa-ad14-9d1d12b0a8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:57.992156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbfc92-c4b0-44aa-ad14-9d1d12b0a8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:57.992435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbfc92-c4b0-44aa-ad14-9d1d12b0a8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:57.994804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d4dbfc92-c4b0-44aa-ad14-9d1d12b0a8f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:58.026765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064623b-23b9-4fd2-82d8-a12e1c99ae88 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.034553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.035291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.035886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.036227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.039290 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.041554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.094609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbfc92-c4b0-44aa-ad14-9d1d12b0a8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.097236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbfc92-c4b0-44aa-ad14-9d1d12b0a8f5 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.133113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 809/1608] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:58.135502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68aa8b-3326-46f9-8868-53ea76a466f4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.135924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68aa8b-3326-46f9-8868-53ea76a466f4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.136286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68aa8b-3326-46f9-8868-53ea76a466f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.147766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 800/1609] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:57 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:58.152509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.190390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3b68aa8b-3326-46f9-8868-53ea76a466f4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:58.191646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3b68aa8b-3326-46f9-8868-53ea76a466f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:58.249029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08635ab5-bf7b-4df1-94b4-6121659ff1b9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.258232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.258911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.259187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.259450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.260738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.263366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.298319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 801/1610] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:58.299512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.301151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:58.324245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 810/1611] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:58.324245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68aa8b-3326-46f9-8868-53ea76a466f4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.351635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68aa8b-3326-46f9-8868-53ea76a466f4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.357114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1535be-2b61-4562-9139-90121c62bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.358504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1535be-2b61-4562-9139-90121c62bbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.359698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1535be-2b61-4562-9139-90121c62bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.359979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1535be-2b61-4562-9139-90121c62bbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.360747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1535be-2b61-4562-9139-90121c62bbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.362867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1535be-2b61-4562-9139-90121c62bbd9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.384378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 811/1612] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:58.385861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e8a6-c4e4-4556-9c3e-91fa63f8550c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.386234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e8a6-c4e4-4556-9c3e-91fa63f8550c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.386417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e8a6-c4e4-4556-9c3e-91fa63f8550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.389677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:58.407379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ba6fb-44b0-41fd-a647-5962eba55417 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.411598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.412405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.412852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.413270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.415543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:58.419739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ee92e8a6-c4e4-4556-9c3e-91fa63f8550c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:58.420959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ee92e8a6-c4e4-4556-9c3e-91fa63f8550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:58.431532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 812/1613] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:58.432574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92e8a6-c4e4-4556-9c3e-91fa63f8550c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.446280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92e8a6-c4e4-4556-9c3e-91fa63f8550c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.451087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.451691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.451971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.452673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.453323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.454993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.456839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:58.467598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 813/1614] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:58.468471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.481419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59758057-3ebf-437d-ab3f-d06874e12129 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.481933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.483406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.486093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.486983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.487397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.487673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.488309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:27:58.488610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.490241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.493388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 802/1615] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:58.494183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.502767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 814/1616] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:27:58.506595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd416cc-7955-4b17-8116-1810be473f75 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.507082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.511577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d6ac9-f284-44e4-b1ea-64300297dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.512524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6ac9-f284-44e4-b1ea-64300297dc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.512903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6ac9-f284-44e4-b1ea-64300297dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.513436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6ac9-f284-44e4-b1ea-64300297dc37 admin admin] PATH_INFO: `/v3/projects/374f7bb5b85a4b9bbfec27d54071ffe6/users/3f05308f41ec4ea4ada2130b5100e9f2/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.518053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c0d2-d16d-4802-b817-1dd00ea0e10c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.522677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.523437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.523791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.524130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.524838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.526857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.535603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d6ac9-f284-44e4-b1ea-64300297dc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f7bb5b85a4b9bbfec27d54071ffe6, user_id=3f05308f41ec4ea4ada2130b5100e9f2, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.538725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d6ac9-f284-44e4-b1ea-64300297dc37 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.561771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 803/1617] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:58 2022] PUT /identity/v3/projects/374f7bb5b85a4b9bbfec27d54071ffe6/users/3f05308f41ec4ea4ada2130b5100e9f2/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:58.574113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19129-ff89-4650-a809-6fe2d0d55967 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.575677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19129-ff89-4650-a809-6fe2d0d55967 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.578336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 815/1618] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/projects => generated 409 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:58.578615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19129-ff89-4650-a809-6fe2d0d55967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.582428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.613999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-61b19129-ff89-4650-a809-6fe2d0d55967 None None] MFA Rules not processed for user `3f05308f41ec4ea4ada2130b5100e9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:58.615261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-61b19129-ff89-4650-a809-6fe2d0d55967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:58.672400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ce7c-97b4-4f68-adcf-7bb9ded5ced0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.682085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.682742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.683126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.683376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.683949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.686270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.721448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 816/1619] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/users => generated 305 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:58.725790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.750854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3caf89-3fbd-4b33-b385-cb86777f42fa admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.751861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 804/1620] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:58.757931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19129-ff89-4650-a809-6fe2d0d55967 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.763081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.763779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.764050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.764321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.764984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.767173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.772409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19129-ff89-4650-a809-6fe2d0d55967 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.778807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.779694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.780080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.780452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.781177 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.782170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 817/1621] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:58.783144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.784233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.800139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69ecb2-3c3c-4bdb-b18d-37dac5205acf admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.813140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:58.813817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:58.814094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:58.814360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:58.815159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:58.821126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:58.821672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 805/1622] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:58.826341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.842528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 818/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:58.843972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:58.864959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4754c7-217c-48b0-be5c-0e50ba054e30 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:58.969478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:59.011053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad628309-70e0-4a29-9c5d-98c639ef7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.012433 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628309-70e0-4a29-9c5d-98c639ef7e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.012667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628309-70e0-4a29-9c5d-98c639ef7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.014863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad628309-70e0-4a29-9c5d-98c639ef7e63 admin admin] PATH_INFO: `/v3/projects/022cec9854d34ef68dd4a5b32a94c4fe/users/b9d7e84b223b4a4992ad313028779458/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.034557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342018b-9957-4a8b-888f-de874b9008b9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.041042 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbab7e-3bb2-48bd-9739-18a153f0c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.041896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbab7e-3bb2-48bd-9739-18a153f0c520 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.042782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbab7e-3bb2-48bd-9739-18a153f0c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.043187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbab7e-3bb2-48bd-9739-18a153f0c520 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.044086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbab7e-3bb2-48bd-9739-18a153f0c520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.046606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbab7e-3bb2-48bd-9739-18a153f0c520 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.055462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad628309-70e0-4a29-9c5d-98c639ef7e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022cec9854d34ef68dd4a5b32a94c4fe, user_id=b9d7e84b223b4a4992ad313028779458, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.079495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad628309-70e0-4a29-9c5d-98c639ef7e63 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.087767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 806/1624] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:58 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:59.088821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b22d-0b8f-4a30-8e1e-49e0549b3d62 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.089257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b22d-0b8f-4a30-8e1e-49e0549b3d62 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.089660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b22d-0b8f-4a30-8e1e-49e0549b3d62 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.091781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 807/1625] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:27:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:27:59.093718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b22d-0b8f-4a30-8e1e-49e0549b3d62 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.106457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 819/1626] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:58 2022] PUT /identity/v3/projects/022cec9854d34ef68dd4a5b32a94c4fe/users/b9d7e84b223b4a4992ad313028779458/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:59.108643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09c77c-7c26-4b1d-9942-b5b3ad6bb0e3 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.114381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09c77c-7c26-4b1d-9942-b5b3ad6bb0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.114898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09c77c-7c26-4b1d-9942-b5b3ad6bb0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.158675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-de09c77c-7c26-4b1d-9942-b5b3ad6bb0e3 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:59.160715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-de09c77c-7c26-4b1d-9942-b5b3ad6bb0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:59.180048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:59.224522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b22d-0b8f-4a30-8e1e-49e0549b3d62 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.229638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee74a9-61ee-4c71-afa4-f086f87459f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.230548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee74a9-61ee-4c71-afa4-f086f87459f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.230860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee74a9-61ee-4c71-afa4-f086f87459f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.231233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee74a9-61ee-4c71-afa4-f086f87459f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.231985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee74a9-61ee-4c71-afa4-f086f87459f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.234509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee74a9-61ee-4c71-afa4-f086f87459f5 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.250270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 808/1627] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:59.250270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a050-ed0c-4da6-a223-039a6384cd35 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.250270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a050-ed0c-4da6-a223-039a6384cd35 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.250270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a050-ed0c-4da6-a223-039a6384cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.268665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 820/1628] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:27:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:59.270257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09c77c-7c26-4b1d-9942-b5b3ad6bb0e3 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.290281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09c77c-7c26-4b1d-9942-b5b3ad6bb0e3 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.291318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-bbd1a050-ed0c-4da6-a223-039a6384cd35 None None] MFA Rules not processed for user `b9d7e84b223b4a4992ad313028779458`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:59.292887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bbd1a050-ed0c-4da6-a223-039a6384cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:59.295520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.296366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.296799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.297937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] PATH_INFO: `/v3/projects/1018ec6442aa43e4a2c212e902e07c65/users/cd9ddec35ddc48b5be2c5955f1effe99/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.315355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1018ec6442aa43e4a2c212e902e07c65, user_id=cd9ddec35ddc48b5be2c5955f1effe99, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.318264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.367879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 821/1629] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:59 2022] PUT /identity/v3/projects/1018ec6442aa43e4a2c212e902e07c65/users/cd9ddec35ddc48b5be2c5955f1effe99/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:27:59.368893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.371078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:59.403392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 809/1630] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:59.404068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a050-ed0c-4da6-a223-039a6384cd35 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.435041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a050-ed0c-4da6-a223-039a6384cd35 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.491496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90249f-534b-4096-b1c4-30703d1e29af admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.500925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.501925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.502538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.503533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.519719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.524403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:59.525336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.538087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.538834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.539192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.539537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.540345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.543778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.544289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 822/1631] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:27:59.545322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.561107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 810/1632] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:59.564084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2947-337d-4eeb-b8e3-64db14832920 service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.565076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.569734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.570660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.571309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.572227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.574194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.578166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938b2d-79e6-42d1-9f9e-82cbf012692d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.578721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.585847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d74c93-d506-413d-915e-2aa8df3cb483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.587654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d74c93-d506-413d-915e-2aa8df3cb483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.587938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d74c93-d506-413d-915e-2aa8df3cb483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.588560 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d74c93-d506-413d-915e-2aa8df3cb483 admin admin] PATH_INFO: `/v3/projects/1018ec6442aa43e4a2c212e902e07c65/users/cd9ddec35ddc48b5be2c5955f1effe99/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.590540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d74c93-d506-413d-915e-2aa8df3cb483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1018ec6442aa43e4a2c212e902e07c65, user_id=cd9ddec35ddc48b5be2c5955f1effe99, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.596103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d74c93-d506-413d-915e-2aa8df3cb483 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.645905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 811/1633] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:59 2022] PUT /identity/v3/projects/1018ec6442aa43e4a2c212e902e07c65/users/cd9ddec35ddc48b5be2c5955f1effe99/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:27:59.657152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.657486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.657843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.691213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 823/1634] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:27:59 2022] POST /identity/v3/projects => generated 409 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:59.692351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.780097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] MFA Rules not processed for user `cd9ddec35ddc48b5be2c5955f1effe99`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:27:59.781392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:59.835656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:59.860806 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad4659-e389-4eb5-82b0-39dea388dc76 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.868903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.869591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.869872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.870191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.870888 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.873350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.907274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 824/1635] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:27:59 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:27:59.911008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.929247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37848180-76ff-4cd9-839e-a9cd1cb57f2a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:27:59.936527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:27:59.937295 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:27:59.937657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:27:59.938025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 812/1636] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:27:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:27:59.938150 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:27:59.939029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:27:59.941811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:27:59.949084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:27:59.951222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:27:59.985355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 825/1637] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:27:59.990871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:00.018504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c557fd-84b4-438f-938c-af09578e4987 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:00.036336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:00.037160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.037731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.038010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] PATH_INFO: `/v3/projects/f1bbeff315df4b69ae07eed877986318/users/fb3204cb03fb4fe88db266fa0e2a747f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:00.067848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7718a98-9c38-4c2e-8981-aa7ade364acf None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:00.077147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bbeff315df4b69ae07eed877986318, user_id=fb3204cb03fb4fe88db266fa0e2a747f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:00.082901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:00.083397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453eb14-d863-40ed-ad6a-e304e1ccc7f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:00.084168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453eb14-d863-40ed-ad6a-e304e1ccc7f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.084581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453eb14-d863-40ed-ad6a-e304e1ccc7f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.085368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453eb14-d863-40ed-ad6a-e304e1ccc7f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:00.087557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9453eb14-d863-40ed-ad6a-e304e1ccc7f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:00.107988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 826/1638] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:27:59 2022] PUT /identity/v3/projects/f1bbeff315df4b69ae07eed877986318/users/fb3204cb03fb4fe88db266fa0e2a747f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:00.127924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:00.216111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d795ff4-41a1-457f-8f91-095632fcd13d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:00.224274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:00.226591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.226907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.227193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:00.228440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:00.230535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:00.245943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 827/1639] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:00.251216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:00.265912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399bd9-b1e6-493c-8bf1-44fb32bf14f9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:00.286407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:00.289953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.291528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.293294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] PATH_INFO: `/v3/projects/f1bbeff315df4b69ae07eed877986318/users/fb3204cb03fb4fe88db266fa0e2a747f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:00.299958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453eb14-d863-40ed-ad6a-e304e1ccc7f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:00.300450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bbeff315df4b69ae07eed877986318, user_id=fb3204cb03fb4fe88db266fa0e2a747f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:00.305035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453eb14-d863-40ed-ad6a-e304e1ccc7f2 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:00.307233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:00.342140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 813/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:27:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:00.348085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 828/1641] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:00 2022] PUT /identity/v3/projects/f1bbeff315df4b69ae07eed877986318/users/fb3204cb03fb4fe88db266fa0e2a747f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:00.359738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b794-d239-475a-a4f6-59732387058f None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.360158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b794-d239-475a-a4f6-59732387058f None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.360455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b794-d239-475a-a4f6-59732387058f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:00.421978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:00.432231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a0a2b794-d239-475a-a4f6-59732387058f None None] MFA Rules not processed for user `fb3204cb03fb4fe88db266fa0e2a747f`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:00.436983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a0a2b794-d239-475a-a4f6-59732387058f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:00.660998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 814/1642] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:00 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:00.697714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:00.832363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f06c63-5c66-411e-ae82-db0fd9aa862e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:00.850990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b05f2d-177c-47ea-a9a9-c9e69e3c5c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:00.851631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05f2d-177c-47ea-a9a9-c9e69e3c5c9f service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.851909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05f2d-177c-47ea-a9a9-c9e69e3c5c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.852174 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05f2d-177c-47ea-a9a9-c9e69e3c5c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:00.880943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b05f2d-177c-47ea-a9a9-c9e69e3c5c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:00.882426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b05f2d-177c-47ea-a9a9-c9e69e3c5c9f service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:00.893493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 829/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:00 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:00.953534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a00a3-511d-488d-b2c4-78174b25d299 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.954694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a00a3-511d-488d-b2c4-78174b25d299 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.955146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a00a3-511d-488d-b2c4-78174b25d299 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:00.957356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 815/1644] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:28:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:28:00.976274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea50e-d577-4b3c-8c7f-856bad0aca7c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:00.977257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea50e-d577-4b3c-8c7f-856bad0aca7c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:00.977701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea50e-d577-4b3c-8c7f-856bad0aca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:01.019553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5feea50e-d577-4b3c-8c7f-856bad0aca7c None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:01.023449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5feea50e-d577-4b3c-8c7f-856bad0aca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:01.090932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:01.233278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 830/1645] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:28:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:01.366038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a00a3-511d-488d-b2c4-78174b25d299 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:01.394731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a00a3-511d-488d-b2c4-78174b25d299 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:01.407757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:01.408872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:01.409699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:01.410077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:01.473611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea50e-d577-4b3c-8c7f-856bad0aca7c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:01.489989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea50e-d577-4b3c-8c7f-856bad0aca7c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:01.505116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:01.506440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:01.507333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:01.508301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:01.524899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:01.530453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:01.536082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:01.536576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:01.560545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 816/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:01.587308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 831/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:28:02.494977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:02.506617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63d139-e0be-452d-849d-6a2857032073 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:02.524268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:02.525327 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:02.529043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:02.535239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:02.619269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:02.621435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:02.636653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 817/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:03.366759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:03.368573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:03.400491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:03.411817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31802ba-0306-45f8-83b9-7c5ab64e2b86 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:03.415908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df90ac-2122-49d0-becb-8bef97b2ae49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:03.416553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df90ac-2122-49d0-becb-8bef97b2ae49 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:03.416832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df90ac-2122-49d0-becb-8bef97b2ae49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:03.417137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df90ac-2122-49d0-becb-8bef97b2ae49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:03.463580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bbffa-9011-48dc-8d05-690f95b4e1dc service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:03.463580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:03.463580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:03.463580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:03.464121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] PATH_INFO: `/v3/users/4e59dceaa88644be934a7c7bb103ac01` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:03.464121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e59dceaa88644be934a7c7bb103ac01)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:03.464501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:03.482586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:03.514479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e59dceaa88644be934a7c7bb103ac01'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:03.514689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df90ac-2122-49d0-becb-8bef97b2ae49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:03.516079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df90ac-2122-49d0-becb-8bef97b2ae49 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:03.521520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e59dceaa88644be934a7c7bb103ac01'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:03.522312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e59dceaa88644be934a7c7bb103ac01'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:03.522941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e59dceaa88644be934a7c7bb103ac01'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:03.526171 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 818/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:28:03.533232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e59dceaa88644be934a7c7bb103ac01'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:03.551685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 832/1650] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:03 2022] DELETE /identity/v3/users/4e59dceaa88644be934a7c7bb103ac01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:03.557285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:03.557770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:03.558170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:03.578970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:03.580205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:03.654685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 819/1651] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:03.664982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:03.666691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:03.691728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:03.730728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef67a7-d207-4486-9f6b-9b4b524f8569 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:03.734962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:03.735823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:03.736108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:03.736399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:03.745598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:03.747093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:03.757033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 833/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:04.197059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:04.198678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:04.212827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7abb7-1ab0-43f4-8c63-f3c71b2e6741 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:04.218019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:04.218670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:04.218987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:04.219415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] PATH_INFO: `/v3/projects/0646d9156a004ba7a70e889f7c32545e` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:04.220537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0646d9156a004ba7a70e889f7c32545e)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:04.222647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:04.278885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0646d9156a004ba7a70e889f7c32545e', 'request_id': 'req-2d47f541-8936-41ed-a141-69bbe92ba5b5'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.288155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0646d9156a004ba7a70e889f7c32545e', 'request_id': 'req-2d47f541-8936-41ed-a141-69bbe92ba5b5'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.294992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0646d9156a004ba7a70e889f7c32545e', 'request_id': 'req-2d47f541-8936-41ed-a141-69bbe92ba5b5'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.306671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] The token cache is being invalidate because project 0646d9156a004ba7a70e889f7c32545e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:04.306983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.307782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.309276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 820/1653] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:04 2022] DELETE /identity/v3/projects/0646d9156a004ba7a70e889f7c32545e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:04.313144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:04.324264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db392e-0c5f-489c-bad8-72f5a92f9bca service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:04.396882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:04.397549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:04.397800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:04.398066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] PATH_INFO: `/v3/users/3b7e1820ebfb4f47945b45cf006b7aa0` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:04.399280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7e1820ebfb4f47945b45cf006b7aa0)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:04.401205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:04.450358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7e1820ebfb4f47945b45cf006b7aa0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.458136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7e1820ebfb4f47945b45cf006b7aa0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.460077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7e1820ebfb4f47945b45cf006b7aa0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.460688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7e1820ebfb4f47945b45cf006b7aa0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.471460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d010634d-6784-4a9c-a0e5-ad5da13e5092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7e1820ebfb4f47945b45cf006b7aa0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:04.511148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 834/1654] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:04 2022] DELETE /identity/v3/users/3b7e1820ebfb4f47945b45cf006b7aa0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:04.919165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:04.920830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:04.953550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f541-8936-41ed-a141-69bbe92ba5b5 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.026173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:05.039546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.040215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.040551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.040897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] PATH_INFO: `/v3/projects/808e22c54b224cf48d41adfb19a70a12` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.042703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=808e22c54b224cf48d41adfb19a70a12)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.044860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.113258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808e22c54b224cf48d41adfb19a70a12', 'request_id': 'req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:05.121718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808e22c54b224cf48d41adfb19a70a12', 'request_id': 'req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:05.128778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808e22c54b224cf48d41adfb19a70a12', 'request_id': 'req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:05.140744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] The token cache is being invalidate because project 808e22c54b224cf48d41adfb19a70a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:05.141037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:05.141720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706475d6-b815-4cbd-a2f8-aa90ca9e0bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:05.143579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 821/1655] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:04 2022] DELETE /identity/v3/projects/808e22c54b224cf48d41adfb19a70a12 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:05.148682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74432e2-ce13-4596-a267-467de08cda9e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.148988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74432e2-ce13-4596-a267-467de08cda9e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.149256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74432e2-ce13-4596-a267-467de08cda9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.174761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c74432e2-ce13-4596-a267-467de08cda9e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:05.176679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c74432e2-ce13-4596-a267-467de08cda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:05.223813 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:05.250589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 835/1656] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:05.258450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2d5a-7495-497d-9599-2a2c2b6ad78e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.259237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2d5a-7495-497d-9599-2a2c2b6ad78e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.259679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2d5a-7495-497d-9599-2a2c2b6ad78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.280272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cefd2d5a-7495-497d-9599-2a2c2b6ad78e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:05.281491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cefd2d5a-7495-497d-9599-2a2c2b6ad78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:05.290865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 822/1657] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:05.296674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74432e2-ce13-4596-a267-467de08cda9e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.313165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74432e2-ce13-4596-a267-467de08cda9e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.320163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.326363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.326363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.326363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.326363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:05.326363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.326363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.363427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 836/1658] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:05.367828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2d5a-7495-497d-9599-2a2c2b6ad78e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.380095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2d5a-7495-497d-9599-2a2c2b6ad78e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.386583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.387893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.388192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.388484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.389162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.391109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.425273 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 823/1659] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:05 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:05.429651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.444330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278c777-8520-4cb5-b963-6d02b7f986e2 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.516366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.516996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.517462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.517727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.518564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.520535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.563675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.566959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 837/1660] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:05 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:05.584524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f1a43-2554-413f-a33f-0533c1c55077 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.592269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.592917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.593238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.593521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.594270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.596981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.617697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 824/1661] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:05.619001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.632197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0f0a2-0ae7-4070-8a06-bfc04e742856 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.639544 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae591b-f4be-4091-8ca2-ff408b5075fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.640534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae591b-f4be-4091-8ca2-ff408b5075fb admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.640962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae591b-f4be-4091-8ca2-ff408b5075fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.641236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae591b-f4be-4091-8ca2-ff408b5075fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.641875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae591b-f4be-4091-8ca2-ff408b5075fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.643643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae591b-f4be-4091-8ca2-ff408b5075fb admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.656489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 838/1662] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:05.661601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.672870 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca359c-d588-44df-8253-fd7c619567c1 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.677679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.678336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.678615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.678942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] PATH_INFO: `/v3/projects/0120e9d75cce4caba68481c9f83f713a/users/d01e3103e0544f3389fd60150dbb7eb8/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.693916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0120e9d75cce4caba68481c9f83f713a, user_id=d01e3103e0544f3389fd60150dbb7eb8, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.696608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.710503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 825/1663] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:05 2022] PUT /identity/v3/projects/0120e9d75cce4caba68481c9f83f713a/users/d01e3103e0544f3389fd60150dbb7eb8/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:05.721351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bff18-70e3-4e0b-8319-1821e7bf55a4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.721643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bff18-70e3-4e0b-8319-1821e7bf55a4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.721935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bff18-70e3-4e0b-8319-1821e7bf55a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.753928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-502bff18-70e3-4e0b-8319-1821e7bf55a4 None None] MFA Rules not processed for user `d01e3103e0544f3389fd60150dbb7eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:05.755193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-502bff18-70e3-4e0b-8319-1821e7bf55a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:05.830855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 839/1664] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:05.835373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.929184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1df912-f890-4669-81bb-c6249b293371 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:05.934675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:05.935330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:05.935605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:05.935874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:05.936508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:05.938440 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:05.972337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 826/1665] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:05 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:05.976602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bff18-70e3-4e0b-8319-1821e7bf55a4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:05.989794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bff18-70e3-4e0b-8319-1821e7bf55a4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:06.036166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:06.074569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:06.075251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:06.075526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:06.075789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:06.076418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:06.078639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:06.104561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 840/1666] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:05 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:06.108957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:06.119204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:06.125252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ad621-a7e8-4178-b799-ccf11f98345c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:06.134672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:06.135348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:06.135610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:06.135956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:06.136800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:06.138610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:06.151509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 827/1667] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:06.157114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:06.168785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16acdb5-b4af-457f-bd25-03dcf46a1381 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:06.175060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:06.175794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:06.176074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:06.176346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] PATH_INFO: `/v3/projects/eba8e4c00ab348888e0b0adb486fc8a4/users/d80ce34064f74f3ca651e2704224ab42/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:06.194896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba8e4c00ab348888e0b0adb486fc8a4, user_id=d80ce34064f74f3ca651e2704224ab42, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:06.197659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:06.216218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 841/1668] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:06 2022] PUT /identity/v3/projects/eba8e4c00ab348888e0b0adb486fc8a4/users/d80ce34064f74f3ca651e2704224ab42/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:06.221555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:06.237201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e39e4-d652-404e-bbe5-64040b745cb1 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:06.313605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92a51a-8cfe-4397-a47d-744e957696f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:06.314281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92a51a-8cfe-4397-a47d-744e957696f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:06.314890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92a51a-8cfe-4397-a47d-744e957696f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:06.315249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92a51a-8cfe-4397-a47d-744e957696f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:06.316091 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92a51a-8cfe-4397-a47d-744e957696f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:06.318201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92a51a-8cfe-4397-a47d-744e957696f0 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:06.334790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 828/1669] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:06.339219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:06.353424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea26d8-9dd0-4da0-aa83-bceee21681cc admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:06.358919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:06.359619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:06.359903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:06.360183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] PATH_INFO: `/v3/projects/eba8e4c00ab348888e0b0adb486fc8a4/users/d80ce34064f74f3ca651e2704224ab42/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:06.362916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba8e4c00ab348888e0b0adb486fc8a4, user_id=d80ce34064f74f3ca651e2704224ab42, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:06.366778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:06.383373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 842/1670] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:06 2022] PUT /identity/v3/projects/eba8e4c00ab348888e0b0adb486fc8a4/users/d80ce34064f74f3ca651e2704224ab42/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:06.395415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:06.395697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:06.395966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:06.444266 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] MFA Rules not processed for user `d80ce34064f74f3ca651e2704224ab42`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:06.445685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:06.571113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 829/1671] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:06.579821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:06.581900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:06.697363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6234-9b45-4f8c-a6c1-85f591e29f37 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:06.716120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c50a2-9223-43b2-9663-09cffa9f18be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:06.716865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c50a2-9223-43b2-9663-09cffa9f18be service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:06.717481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c50a2-9223-43b2-9663-09cffa9f18be service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:06.717481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c50a2-9223-43b2-9663-09cffa9f18be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:06.795402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c50a2-9223-43b2-9663-09cffa9f18be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:06.797231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c50a2-9223-43b2-9663-09cffa9f18be service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:06.813493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 843/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:07.224433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:07.225906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:07.317365 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8997704-a6d8-44d9-a866-8596f35c6a4c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:07.330935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:07.331511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:07.331939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:07.332215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] PATH_INFO: `/v3/users/b9d7e84b223b4a4992ad313028779458` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:07.333393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d7e84b223b4a4992ad313028779458)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:07.335405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:07.354534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:07.388688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d7e84b223b4a4992ad313028779458'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.396131 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d7e84b223b4a4992ad313028779458'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.396848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d7e84b223b4a4992ad313028779458'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.397496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d7e84b223b4a4992ad313028779458'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.406144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d7e84b223b4a4992ad313028779458'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.426118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 830/1673] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:07 2022] DELETE /identity/v3/users/b9d7e84b223b4a4992ad313028779458 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:07.430721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:07.431047 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:07.431330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:07.450181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:07.451417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:07.491202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:07.510881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 844/1674] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:07.521912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:07.523590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:07.583377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3ccab-4b4b-4563-bdf9-b78f542e1843 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:07.587597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099024db-d975-4d59-8b08-4f066bf2c961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:07.588240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099024db-d975-4d59-8b08-4f066bf2c961 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:07.588517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099024db-d975-4d59-8b08-4f066bf2c961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:07.588785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099024db-d975-4d59-8b08-4f066bf2c961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:07.599094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099024db-d975-4d59-8b08-4f066bf2c961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:07.603530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099024db-d975-4d59-8b08-4f066bf2c961 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:07.614380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 831/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:07.646713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:07.648702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:07.661002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2367-e8bb-4274-8b9d-430d0e323bba None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:07.668957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:07.669629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:07.669916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:07.670196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] PATH_INFO: `/v3/users/8d48d31d862a4ac6a79ea8daec54da29` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:07.671408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d48d31d862a4ac6a79ea8daec54da29)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:07.673462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:07.730865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d48d31d862a4ac6a79ea8daec54da29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.739584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d48d31d862a4ac6a79ea8daec54da29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.740534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d48d31d862a4ac6a79ea8daec54da29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.741349 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d48d31d862a4ac6a79ea8daec54da29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.750740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d48d31d862a4ac6a79ea8daec54da29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:07.772068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 845/1676] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:07 2022] DELETE /identity/v3/users/8d48d31d862a4ac6a79ea8daec54da29 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:07.776380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:07.776730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:07.777005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:07.807323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:07.808668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:07.921323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 832/1677] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:07.951555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:07.953104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:08.031918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da733369-82af-45a4-9d56-7550a46fe43f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:08.035898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:08.036536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:08.036813 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:08.037089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:08.049721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:08.050732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:08.063801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 846/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:08.355123 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:08.356681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:08.371025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a9cb3-9b91-48d1-8821-a637ddf0de58 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:08.376675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:08.377406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:08.377728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:08.378259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] PATH_INFO: `/v3/projects/022cec9854d34ef68dd4a5b32a94c4fe` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:08.380529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022cec9854d34ef68dd4a5b32a94c4fe)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:08.382596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:08.443267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:08.464318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022cec9854d34ef68dd4a5b32a94c4fe', 'request_id': 'req-b6f57984-afda-4f67-b6fe-0eb31a2ea785'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.480183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022cec9854d34ef68dd4a5b32a94c4fe', 'request_id': 'req-b6f57984-afda-4f67-b6fe-0eb31a2ea785'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.493420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022cec9854d34ef68dd4a5b32a94c4fe', 'request_id': 'req-b6f57984-afda-4f67-b6fe-0eb31a2ea785'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.510452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] The token cache is being invalidate because project 022cec9854d34ef68dd4a5b32a94c4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:08.510790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.511446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.516254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 833/1679] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:08 2022] DELETE /identity/v3/projects/022cec9854d34ef68dd4a5b32a94c4fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:08.517552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:08.528049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3caa19-040e-459e-b1be-46f98469057d service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:08.682441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:08.683238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:08.683515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:08.683784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] PATH_INFO: `/v3/users/fb3204cb03fb4fe88db266fa0e2a747f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:08.687603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3204cb03fb4fe88db266fa0e2a747f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:08.690646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:08.696538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:08.772190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3204cb03fb4fe88db266fa0e2a747f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.780494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3204cb03fb4fe88db266fa0e2a747f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.781591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3204cb03fb4fe88db266fa0e2a747f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.782446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3204cb03fb4fe88db266fa0e2a747f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.794305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3204cb03fb4fe88db266fa0e2a747f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:08.823308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 847/1680] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:08 2022] DELETE /identity/v3/users/fb3204cb03fb4fe88db266fa0e2a747f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:09.148571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:09.150892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:09.168691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f57984-afda-4f67-b6fe-0eb31a2ea785 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:09.248460 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:09.249439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:09.249439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:09.249705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] PATH_INFO: `/v3/projects/b92eb631563a4dc185111d27510f38ea` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:09.250895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92eb631563a4dc185111d27510f38ea)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:09.253343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:09.311483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92eb631563a4dc185111d27510f38ea', 'request_id': 'req-2b7ac54b-cc72-4930-8ab0-342bec01a21c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.323418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92eb631563a4dc185111d27510f38ea', 'request_id': 'req-2b7ac54b-cc72-4930-8ab0-342bec01a21c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.340459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92eb631563a4dc185111d27510f38ea', 'request_id': 'req-2b7ac54b-cc72-4930-8ab0-342bec01a21c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.361443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] The token cache is being invalidate because project b92eb631563a4dc185111d27510f38ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:09.362236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.362803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.364546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:09.367055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:09.383153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff985225-b84e-48d8-8c68-e7cb1880cab8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:09.389186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 834/1681] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:09 2022] DELETE /identity/v3/projects/b92eb631563a4dc185111d27510f38ea => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:09.391697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:09.393531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:09.491146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:09.504998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:09.506905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:09.506905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:09.506905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] PATH_INFO: `/v3/projects/f1bbeff315df4b69ae07eed877986318` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:09.515725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bbeff315df4b69ae07eed877986318)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:09.517724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:09.520380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac54b-cc72-4930-8ab0-342bec01a21c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:09.525417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:09.526160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:09.526505 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:09.527790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] PATH_INFO: `/v3/users/3f05308f41ec4ea4ada2130b5100e9f2` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:09.529364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f05308f41ec4ea4ada2130b5100e9f2)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:09.531906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:09.626714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bbeff315df4b69ae07eed877986318', 'request_id': 'req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.633241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f05308f41ec4ea4ada2130b5100e9f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.642197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bbeff315df4b69ae07eed877986318', 'request_id': 'req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.655440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bbeff315df4b69ae07eed877986318', 'request_id': 'req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.657003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f05308f41ec4ea4ada2130b5100e9f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.658173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f05308f41ec4ea4ada2130b5100e9f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.662078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f05308f41ec4ea4ada2130b5100e9f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.681937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] The token cache is being invalidate because project f1bbeff315df4b69ae07eed877986318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:09.683271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.685490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1c87b3da-1508-4a9d-aec1-ac6fdb667982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f05308f41ec4ea4ada2130b5100e9f2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.688603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-583621ae-e1e3-4810-a104-cd7a1c0b2aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:09.693167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 848/1682] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:09 2022] DELETE /identity/v3/projects/f1bbeff315df4b69ae07eed877986318 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:09.698049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe029-671b-473a-b9de-4b2c31196b65 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:09.698417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe029-671b-473a-b9de-4b2c31196b65 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:09.698797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe029-671b-473a-b9de-4b2c31196b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:09.733419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 835/1683] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:09 2022] DELETE /identity/v3/users/3f05308f41ec4ea4ada2130b5100e9f2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:09.746542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f2afe029-671b-473a-b9de-4b2c31196b65 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:09.748348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f2afe029-671b-473a-b9de-4b2c31196b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:09.756525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:09.925311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 849/1684] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:09.933385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd19a0-e1a0-4dc1-b22d-e21e63c605ba None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:09.933982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd19a0-e1a0-4dc1-b22d-e21e63c605ba None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:09.934479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd19a0-e1a0-4dc1-b22d-e21e63c605ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:09.989178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-85cd19a0-e1a0-4dc1-b22d-e21e63c605ba None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:09.990474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-85cd19a0-e1a0-4dc1-b22d-e21e63c605ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:09.999030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 836/1685] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:10.003223 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe029-671b-473a-b9de-4b2c31196b65 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.019094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe029-671b-473a-b9de-4b2c31196b65 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.025499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.026192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.026571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.026939 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.028244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:10.028877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.031768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.046571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 850/1686] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:10.050857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd19a0-e1a0-4dc1-b22d-e21e63c605ba None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.061614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd19a0-e1a0-4dc1-b22d-e21e63c605ba None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.068468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.069546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.069546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.069915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.070621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.073167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.103564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 837/1687] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:10 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:10.107340 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.117793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806282-a99d-484a-8e30-bfaa8fc5d131 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.156652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.158661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:10.195096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.195753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.196704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.197236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.198455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.199953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.223519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 851/1688] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:10 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:10.227374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.239413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ed7a-aa76-4e30-9247-204b03c2586d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.244438 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.245069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.245425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.245642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.246246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.248028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.253067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bec9-a9d2-490f-b50b-80eeb18fee19 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.258756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.259567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.259912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.259988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 852/1689] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:10.260148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] PATH_INFO: `/v3/projects/374f7bb5b85a4b9bbfec27d54071ffe6` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.261236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=374f7bb5b85a4b9bbfec27d54071ffe6)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.263296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.264281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.277375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b618a-8f11-42bb-ad67-3cd221242269 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.284640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.285263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.285541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.285820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.289654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.291338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.311138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 853/1690] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:10.315841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.343318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:10.347179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374f7bb5b85a4b9bbfec27d54071ffe6', 'request_id': 'req-7058b911-a463-40b5-826d-330a19019c3e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.349514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d869f2-77fd-47c7-ad3e-1becfed95a34 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.362376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374f7bb5b85a4b9bbfec27d54071ffe6', 'request_id': 'req-7058b911-a463-40b5-826d-330a19019c3e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.374248 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374f7bb5b85a4b9bbfec27d54071ffe6', 'request_id': 'req-7058b911-a463-40b5-826d-330a19019c3e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.408552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] The token cache is being invalidate because project 374f7bb5b85a4b9bbfec27d54071ffe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:10.408989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.409844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.412389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 838/1691] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:10 2022] DELETE /identity/v3/projects/374f7bb5b85a4b9bbfec27d54071ffe6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:10.416516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.418369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:10.468771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4da97b-238f-4cf4-9fdc-073c0eeda5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.469781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4da97b-238f-4cf4-9fdc-073c0eeda5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.470119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4da97b-238f-4cf4-9fdc-073c0eeda5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.470455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4da97b-238f-4cf4-9fdc-073c0eeda5c6 admin admin] PATH_INFO: `/v3/projects/0ce44f04da914fb0b0f341b6fe459237/users/95f1911f4a3444e292bcd734d4d31d77/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.481810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:10.493409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4da97b-238f-4cf4-9fdc-073c0eeda5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce44f04da914fb0b0f341b6fe459237, user_id=95f1911f4a3444e292bcd734d4d31d77, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.496106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4da97b-238f-4cf4-9fdc-073c0eeda5c6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.518972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 854/1692] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:10 2022] PUT /identity/v3/projects/0ce44f04da914fb0b0f341b6fe459237/users/95f1911f4a3444e292bcd734d4d31d77/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:10.524012 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.524300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.524574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.526886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058b911-a463-40b5-826d-330a19019c3e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.543767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:10.544979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:10.582074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.582718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.583054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.583326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] PATH_INFO: `/v3/users/cd9ddec35ddc48b5be2c5955f1effe99` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.584510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9ddec35ddc48b5be2c5955f1effe99)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.586428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.606710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 855/1693] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:10.617683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:10.619114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:10.638728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9ddec35ddc48b5be2c5955f1effe99'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.645815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9ddec35ddc48b5be2c5955f1effe99'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.646550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9ddec35ddc48b5be2c5955f1effe99'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.647169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9ddec35ddc48b5be2c5955f1effe99'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.655707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9ddec35ddc48b5be2c5955f1effe99'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:10.669557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:10.675708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 839/1694] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:10 2022] DELETE /identity/v3/users/cd9ddec35ddc48b5be2c5955f1effe99 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:10.683938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4268ea2-0280-4f6e-aaf8-87fc45bf3c7d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:10.737570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfe279-23cc-48d7-a8c4-046819ac68d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:10.738342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe279-23cc-48d7-a8c4-046819ac68d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:10.738613 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe279-23cc-48d7-a8c4-046819ac68d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:10.738940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe279-23cc-48d7-a8c4-046819ac68d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:10.741053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9adfe279-23cc-48d7-a8c4-046819ac68d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:10.805525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:10.809989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfe279-23cc-48d7-a8c4-046819ac68d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:10.812071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfe279-23cc-48d7-a8c4-046819ac68d1 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:10.823123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 856/1695] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:28:11.072546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.074288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:11.090700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10063-19c2-4724-8613-7c62b3adb52d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.105196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.106830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.107342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.107620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] PATH_INFO: `/v3/projects/1018ec6442aa43e4a2c212e902e07c65` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.108834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1018ec6442aa43e4a2c212e902e07c65)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:11.111125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:11.197663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1018ec6442aa43e4a2c212e902e07c65', 'request_id': 'req-c52f16cb-b084-4be6-b994-a904e31a4f62'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:11.209930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1018ec6442aa43e4a2c212e902e07c65', 'request_id': 'req-c52f16cb-b084-4be6-b994-a904e31a4f62'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:11.234092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1018ec6442aa43e4a2c212e902e07c65', 'request_id': 'req-c52f16cb-b084-4be6-b994-a904e31a4f62'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:11.248925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] The token cache is being invalidate because project 1018ec6442aa43e4a2c212e902e07c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:11.249282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:11.250083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c52f16cb-b084-4be6-b994-a904e31a4f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:11.252199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 840/1696] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:11 2022] DELETE /identity/v3/projects/1018ec6442aa43e4a2c212e902e07c65 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:11.257095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243193a2-ebfd-40de-8119-5b90396389aa None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.257461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243193a2-ebfd-40de-8119-5b90396389aa None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.257734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243193a2-ebfd-40de-8119-5b90396389aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.280989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-243193a2-ebfd-40de-8119-5b90396389aa None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:11.282505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-243193a2-ebfd-40de-8119-5b90396389aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:11.355821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 857/1697] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:11.363926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf8d7b-22cf-40ea-b994-78e5b907e4d8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.364417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf8d7b-22cf-40ea-b994-78e5b907e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.364489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf8d7b-22cf-40ea-b994-78e5b907e4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.384986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-54bf8d7b-22cf-40ea-b994-78e5b907e4d8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:11.386221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-54bf8d7b-22cf-40ea-b994-78e5b907e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:11.394434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 841/1698] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:11.398851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243193a2-ebfd-40de-8119-5b90396389aa None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.408585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243193a2-ebfd-40de-8119-5b90396389aa None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.413421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.414129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.414407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.414678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.415349 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:11.415646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:11.417241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:11.444991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 858/1699] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:11.455525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf8d7b-22cf-40ea-b994-78e5b907e4d8 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.466964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf8d7b-22cf-40ea-b994-78e5b907e4d8 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.471706 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.472324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.472599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.472861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.475026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:11.475549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:11.513444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 842/1700] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:11 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:11.515388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.532912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e4efb-336e-40f3-8925-60b46965c1a4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.620606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.621647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.622039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.622411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.623160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:11.625982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.627853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:11.642992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:11.697294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 859/1701] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:11 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:11.699997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.725217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb79215-1fd5-43ff-9ede-1e0efd41c5ec admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.735993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.738911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.739198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.739465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.741573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:11.747630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:11.777813 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 860/1702] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:11.781990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.806057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848337b3-f187-4c46-a534-af4dd7d604a9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.821172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.823034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.823329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.823600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.826837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:11.828624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:11.829932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c1991-91b5-4b1a-a988-3da674ed10b0 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.842335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.843376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.845160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 861/1703] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:11.845519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.846875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.849435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:11.852282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:11.859981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a53d-f376-41e1-9fa2-c527fa9b0e0a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:11.872627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fde14c-a01e-43a7-bf8d-9bc44be240d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:11.873306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fde14c-a01e-43a7-bf8d-9bc44be240d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.873578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fde14c-a01e-43a7-bf8d-9bc44be240d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.873845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fde14c-a01e-43a7-bf8d-9bc44be240d9 admin admin] PATH_INFO: `/v3/projects/28ad96bcfe164c2e8ea7c1403818d3e8/users/fbdb5a17211646d8a73b6bb5f686c9d6/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:11.910328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fde14c-a01e-43a7-bf8d-9bc44be240d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ad96bcfe164c2e8ea7c1403818d3e8, user_id=fbdb5a17211646d8a73b6bb5f686c9d6, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:11.919451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fde14c-a01e-43a7-bf8d-9bc44be240d9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:11.949430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 862/1704] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:11 2022] PUT /identity/v3/projects/28ad96bcfe164c2e8ea7c1403818d3e8/users/fbdb5a17211646d8a73b6bb5f686c9d6/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:11.962161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9d60-c990-4f29-88c2-7a3cc32f2ac2 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:11.962463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9d60-c990-4f29-88c2-7a3cc32f2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:11.962756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9d60-c990-4f29-88c2-7a3cc32f2ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:12.004336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:12.005782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:12.011434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-558e9d60-c990-4f29-88c2-7a3cc32f2ac2 None None] MFA Rules not processed for user `fbdb5a17211646d8a73b6bb5f686c9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:12.012587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-558e9d60-c990-4f29-88c2-7a3cc32f2ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:12.016238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 843/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:28:12.027439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:12.112549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 863/1706] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:12.126742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:12.128611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:12.139813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:12.145597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03d86-2573-4110-8fb1-bf575758e268 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:12.214220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:12.215071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:12.215425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:12.215861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:12.225429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:12.227004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:12.241319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 844/1707] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:12.399816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f89d-fe20-4703-8c3c-1059c9c1116f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:12.400102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f89d-fe20-4703-8c3c-1059c9c1116f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:12.400376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f89d-fe20-4703-8c3c-1059c9c1116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:12.455418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-b144f89d-fe20-4703-8c3c-1059c9c1116f None None] MFA Rules not processed for user `95f1911f4a3444e292bcd734d4d31d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:12.457908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b144f89d-fe20-4703-8c3c-1059c9c1116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:12.579788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 864/1708] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:12.585114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:12.586573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:12.688431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536f16-38a1-44c4-be0e-d3bbddd0ff09 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:12.700180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:12.701335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:12.701618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:12.701891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:12.702542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:12.704892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:12.762507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 845/1709] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:12 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:12.766671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f89d-fe20-4703-8c3c-1059c9c1116f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:12.784386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f89d-fe20-4703-8c3c-1059c9c1116f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:12.923466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:12.924468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:12.924979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:12.925881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:12.926743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:12.929877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:12.978181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 865/1710] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:12 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:12.979697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:12.990655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e55f-ce72-459a-ad6c-06aa2c180bbc admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:12.997121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:12.997453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:12.997453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:12.997770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:12.998419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:13.000420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:13.022632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 846/1711] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:13.027531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:13.043009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb99dff-95d4-497a-b668-5a9e88da2ba0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:13.051618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:13.053285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:13.053651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:13.053930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] PATH_INFO: `/v3/projects/b19c3dffc88744ba941a3b52a898ef39/users/73a3fed96f54429fb9ace70b13789211/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:13.073796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19c3dffc88744ba941a3b52a898ef39, user_id=73a3fed96f54429fb9ace70b13789211, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:13.075064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:13.091160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 866/1712] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:13 2022] PUT /identity/v3/projects/b19c3dffc88744ba941a3b52a898ef39/users/73a3fed96f54429fb9ace70b13789211/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:13.095012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:13.105799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4f9fb-fffe-4886-b04b-0fa98a075500 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:13.187770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668f035-34b6-49e6-bb26-a242063cae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:13.188457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668f035-34b6-49e6-bb26-a242063cae0b admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:13.188734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668f035-34b6-49e6-bb26-a242063cae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:13.189006 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668f035-34b6-49e6-bb26-a242063cae0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:13.189685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668f035-34b6-49e6-bb26-a242063cae0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:13.191517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668f035-34b6-49e6-bb26-a242063cae0b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:13.202613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 847/1713] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:13.207374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:13.225447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f092-b500-40bd-95ae-defad7302ffc admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:13.232669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:13.233606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:13.233953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:13.234263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] PATH_INFO: `/v3/projects/b19c3dffc88744ba941a3b52a898ef39/users/73a3fed96f54429fb9ace70b13789211/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:13.237135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19c3dffc88744ba941a3b52a898ef39, user_id=73a3fed96f54429fb9ace70b13789211, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:13.241046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:13.246783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:13.263418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 867/1714] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:13 2022] PUT /identity/v3/projects/b19c3dffc88744ba941a3b52a898ef39/users/73a3fed96f54429fb9ace70b13789211/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:14.027658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0922a-f0c5-499a-ad52-f04e5551a604 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:14.028253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0922a-f0c5-499a-ad52-f04e5551a604 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:14.028253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0922a-f0c5-499a-ad52-f04e5551a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:14.079374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a0c0922a-f0c5-499a-ad52-f04e5551a604 None None] MFA Rules not processed for user `73a3fed96f54429fb9ace70b13789211`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:14.081897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a0c0922a-f0c5-499a-ad52-f04e5551a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.090963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:14.118254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:14.120108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.213918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 848/1715] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:14.225382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c52cfd-bcc2-417b-bbeb-5e088a425b45 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:14.225661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c52cfd-bcc2-417b-bbeb-5e088a425b45 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:14.226095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c52cfd-bcc2-417b-bbeb-5e088a425b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:14.244856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe14280-796c-4c71-b106-302a83c28687 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:14.250058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b4c52cfd-bcc2-417b-bbeb-5e088a425b45 None None] MFA Rules not processed for user `95f1911f4a3444e292bcd734d4d31d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:14.250726 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:14.251577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:14.251702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b4c52cfd-bcc2-417b-bbeb-5e088a425b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.252718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:14.252973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] PATH_INFO: `/v3/users/451189400cf1476f94386d1ea760d823` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:14.254255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=451189400cf1476f94386d1ea760d823)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:14.261123 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:14.321761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451189400cf1476f94386d1ea760d823'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:14.327127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 849/1716] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:14.332209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451189400cf1476f94386d1ea760d823'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:14.333293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451189400cf1476f94386d1ea760d823'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:14.334079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451189400cf1476f94386d1ea760d823'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:14.357525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451189400cf1476f94386d1ea760d823'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:14.391716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 868/1717] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:14 2022] DELETE /identity/v3/users/451189400cf1476f94386d1ea760d823 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:14.396688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:14.397156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:14.397421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:14.424738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:14.426250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.493821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 850/1718] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:14.503745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:14.505351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.564127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d49d03-f7f7-4872-83a2-1b9a8e97b55b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:14.568113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:14.568672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:14.568991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:14.569242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:14.578853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:14.580424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:14.592059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 869/1719] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:14.607168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:14.609108 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.664772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:14.692925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e7ac-9864-4e0e-a8f7-8c06de55ac23 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:14.698737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686c27-0b8d-4579-bfd2-988a4b353747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:14.699406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686c27-0b8d-4579-bfd2-988a4b353747 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:14.699807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686c27-0b8d-4579-bfd2-988a4b353747 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:14.700078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686c27-0b8d-4579-bfd2-988a4b353747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:14.702079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e9686c27-0b8d-4579-bfd2-988a4b353747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.762271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9686c27-0b8d-4579-bfd2-988a4b353747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:14.763908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9686c27-0b8d-4579-bfd2-988a4b353747 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:14.773436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 851/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:14.881067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:14.884701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:14.905681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2667237-4c05-4de4-8238-1c4eff1b7d92 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:14.911979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:14.912685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:14.913071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:14.913405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] PATH_INFO: `/v3/projects/98d211cc4cee4da4b03c5e061580b27f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:14.915730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d211cc4cee4da4b03c5e061580b27f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:14.918451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:14.943210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:14.993894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d211cc4cee4da4b03c5e061580b27f', 'request_id': 'req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:15.004512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d211cc4cee4da4b03c5e061580b27f', 'request_id': 'req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:15.012113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d211cc4cee4da4b03c5e061580b27f', 'request_id': 'req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:15.032521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] The token cache is being invalidate because project 98d211cc4cee4da4b03c5e061580b27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:15.033017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:15.033969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5004f1ed-b6f7-44ea-8f63-6e834c1e22ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:15.036729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 870/1721] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:14 2022] DELETE /identity/v3/projects/98d211cc4cee4da4b03c5e061580b27f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:15.041375 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ae843-3958-44a7-a736-01765311e779 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.041908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ae843-3958-44a7-a736-01765311e779 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.041908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ae843-3958-44a7-a736-01765311e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.081412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-550ae843-3958-44a7-a736-01765311e779 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:15.083032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-550ae843-3958-44a7-a736-01765311e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:15.150645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 852/1722] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:15.158317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a804068-2ed6-40ec-b3ef-0254b38d995d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.158843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a804068-2ed6-40ec-b3ef-0254b38d995d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.159080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a804068-2ed6-40ec-b3ef-0254b38d995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.181716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7a804068-2ed6-40ec-b3ef-0254b38d995d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:15.183259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7a804068-2ed6-40ec-b3ef-0254b38d995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:15.194274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 871/1723] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:15.198926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ae843-3958-44a7-a736-01765311e779 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:15.209307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ae843-3958-44a7-a736-01765311e779 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:15.214325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:15.214955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.215406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.215673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.216404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:15.216857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:15.218656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:15.231129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 853/1724] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:15.236108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a804068-2ed6-40ec-b3ef-0254b38d995d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:15.247022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a804068-2ed6-40ec-b3ef-0254b38d995d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:15.252485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:15.253274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.253685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.254455 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.255149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:15.257141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:15.290004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 872/1725] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:15 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:15.292051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:15.313768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b37548-65a5-4bad-aad6-cd6606056d7b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:15.386078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:15.386885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.387286 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.388257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.388257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:15.390905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:15.422911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:15.432587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 854/1726] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:15 2022] POST /identity/v3/users => generated 280 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:15.436787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:15.466924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e91533-6bac-448c-b0c4-df1453ba2cc6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:15.473095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:15.473905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.474291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.475190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.475952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:15.477728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:15.507479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 873/1727] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:15.520167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:15.530965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bc41d-33b2-4228-bc38-0b3358670b63 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:15.547303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e85d1-6fa3-4dce-b086-c9d1ef780014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:15.547934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e85d1-6fa3-4dce-b086-c9d1ef780014 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.548256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e85d1-6fa3-4dce-b086-c9d1ef780014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.548479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e85d1-6fa3-4dce-b086-c9d1ef780014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.549209 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e85d1-6fa3-4dce-b086-c9d1ef780014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:15.550897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e85d1-6fa3-4dce-b086-c9d1ef780014 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:15.586159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 855/1728] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:15.587623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:15.608256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71966895-7535-4170-bac4-1250fdfb7090 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:15.613579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:15.614262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.614528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.614805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] PATH_INFO: `/v3/projects/a892bd229499414fa54fbf8ed6681f6d/users/4f65f9c6ee5f4792a43039eaa94f1b0c/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.634578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a892bd229499414fa54fbf8ed6681f6d, user_id=4f65f9c6ee5f4792a43039eaa94f1b0c, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:15.637627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:15.654611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 874/1729] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:15 2022] PUT /identity/v3/projects/a892bd229499414fa54fbf8ed6681f6d/users/4f65f9c6ee5f4792a43039eaa94f1b0c/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:15.666026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a56d5-9fb3-4cfb-a9e2-e806572f24ab None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:15.666496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a56d5-9fb3-4cfb-a9e2-e806572f24ab None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:15.666774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a56d5-9fb3-4cfb-a9e2-e806572f24ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:15.730374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cb5a56d5-9fb3-4cfb-a9e2-e806572f24ab None None] MFA Rules not processed for user `4f65f9c6ee5f4792a43039eaa94f1b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:15.733818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cb5a56d5-9fb3-4cfb-a9e2-e806572f24ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:15.850664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 856/1730] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:15.903007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:15.910798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:16.013315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437d72-2be1-47aa-925f-48dd77b3ea39 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:16.017094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06955b8-bb5f-4fa6-89ac-082ee7d98a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:16.017857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06955b8-bb5f-4fa6-89ac-082ee7d98a45 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:16.018127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06955b8-bb5f-4fa6-89ac-082ee7d98a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:16.018419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06955b8-bb5f-4fa6-89ac-082ee7d98a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:16.027574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06955b8-bb5f-4fa6-89ac-082ee7d98a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:16.029237 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06955b8-bb5f-4fa6-89ac-082ee7d98a45 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:16.039624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 875/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:16.060875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a56d5-9fb3-4cfb-a9e2-e806572f24ab None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:16.142407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a56d5-9fb3-4cfb-a9e2-e806572f24ab None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:16.147387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:16.148014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:16.148292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:16.148562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] PATH_INFO: `/v3/users/4f65f9c6ee5f4792a43039eaa94f1b0c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:16.152212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f65f9c6ee5f4792a43039eaa94f1b0c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:16.154415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:16.204838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f65f9c6ee5f4792a43039eaa94f1b0c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.211799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f65f9c6ee5f4792a43039eaa94f1b0c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.212493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f65f9c6ee5f4792a43039eaa94f1b0c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.213082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f65f9c6ee5f4792a43039eaa94f1b0c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.221919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f65f9c6ee5f4792a43039eaa94f1b0c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.234351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:16.239986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 857/1732] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:16 2022] DELETE /identity/v3/users/4f65f9c6ee5f4792a43039eaa94f1b0c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:16.245023 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:16.245505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:16.245611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:16.265404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:16.266611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:16.300795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:16.332659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 876/1733] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:16.342913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:16.344384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:16.406908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ff6f-fcc9-4bad-9ec3-5896f70ee888 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:16.410963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d758fb-578a-40b3-ad0b-18f8ae521d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:16.411589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d758fb-578a-40b3-ad0b-18f8ae521d11 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:16.411868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d758fb-578a-40b3-ad0b-18f8ae521d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:16.412130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d758fb-578a-40b3-ad0b-18f8ae521d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:16.421740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d758fb-578a-40b3-ad0b-18f8ae521d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:16.423274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d758fb-578a-40b3-ad0b-18f8ae521d11 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:16.434560 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 858/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:16.865774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:16.868239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:16.884032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89159fc-9e85-49db-bd1d-d8ca746e51a0 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:16.889554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:16.890546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:16.890800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:16.891095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] PATH_INFO: `/v3/projects/a892bd229499414fa54fbf8ed6681f6d` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:16.892401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a892bd229499414fa54fbf8ed6681f6d)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:16.895112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:16.945961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a892bd229499414fa54fbf8ed6681f6d', 'request_id': 'req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.955839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a892bd229499414fa54fbf8ed6681f6d', 'request_id': 'req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.963628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a892bd229499414fa54fbf8ed6681f6d', 'request_id': 'req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.975242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] The token cache is being invalidate because project a892bd229499414fa54fbf8ed6681f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:16.975718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.976672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-927837cd-2a1c-4b82-93a3-7ca35f70a8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:16.980986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 877/1735] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:16 2022] DELETE /identity/v3/projects/a892bd229499414fa54fbf8ed6681f6d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:16.985368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb58e-7950-4d5a-9965-b258bb81c930 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:16.985653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb58e-7950-4d5a-9965-b258bb81c930 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:16.985951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb58e-7950-4d5a-9965-b258bb81c930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.009306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b70cb58e-7950-4d5a-9965-b258bb81c930 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:17.010530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b70cb58e-7950-4d5a-9965-b258bb81c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:17.111600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 859/1736] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:17.124161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29a24-36d8-479f-8baa-a66f03ab8fc5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.124902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29a24-36d8-479f-8baa-a66f03ab8fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.125370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29a24-36d8-479f-8baa-a66f03ab8fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.160904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-04e29a24-36d8-479f-8baa-a66f03ab8fc5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:17.162538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-04e29a24-36d8-479f-8baa-a66f03ab8fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:17.173176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 878/1737] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:17.177212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb58e-7950-4d5a-9965-b258bb81c930 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.195250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb58e-7950-4d5a-9965-b258bb81c930 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.200851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.202205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.202681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.203451 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.204495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:17.205022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.207037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.226067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 860/1738] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:17.226625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29a24-36d8-479f-8baa-a66f03ab8fc5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.245136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29a24-36d8-479f-8baa-a66f03ab8fc5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.248463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.249509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.249792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.251450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.252390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.252919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.254199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:17.256527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.284407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c16c3-ca24-4b3a-a3a7-b14c3bf5044f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.289407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.290203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.290644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.291096 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] PATH_INFO: `/v3/users/d01e3103e0544f3389fd60150dbb7eb8` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.292829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01e3103e0544f3389fd60150dbb7eb8)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.294967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.309092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 879/1739] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:17 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:17.313119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.368453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01e3103e0544f3389fd60150dbb7eb8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:17.376733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01e3103e0544f3389fd60150dbb7eb8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:17.377659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01e3103e0544f3389fd60150dbb7eb8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:17.379454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01e3103e0544f3389fd60150dbb7eb8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:17.388978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-13976280-3e84-448e-8faf-c49975c3f01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01e3103e0544f3389fd60150dbb7eb8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:17.397508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eab6e8-ae5c-4c4e-a6c6-d509f9541015 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.402910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.403522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.403804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.404070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.404708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.406622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.407132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:17.420770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 861/1740] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:17 2022] DELETE /identity/v3/users/d01e3103e0544f3389fd60150dbb7eb8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:17.427017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.427482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.427917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.443535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 880/1741] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:17 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:17.444293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.446001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:17.449657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:17.450879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:17.459190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00e20-e963-41da-80b2-7f96ed32e986 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.485408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:17.526218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 862/1742] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:17.533579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.534221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.534520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.534793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.535552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.536412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.537487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.537797 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:17.548807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 881/1743] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:17.552861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.565347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0857d1-28da-4af4-9838-c643d3991703 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.573405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.574042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.574316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.574584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.575303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.576931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.587475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 882/1744] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:17.592475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.609556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fc452-bf6c-4d1a-9b09-1670b0377318 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.611022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba27d4-eae7-40da-a94f-a5b99c546cf4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.615043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.615880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.616221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.616615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] PATH_INFO: `/v3/projects/2cb847b356aa4788a94b96b03f58cb29/users/b3f2b7d5d25944e5a970fad1ee136f77/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.617455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762d96-8e1b-4984-b444-5648f34487a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.617933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762d96-8e1b-4984-b444-5648f34487a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.618223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762d96-8e1b-4984-b444-5648f34487a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.618778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762d96-8e1b-4984-b444-5648f34487a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.628457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01762d96-8e1b-4984-b444-5648f34487a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.629886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01762d96-8e1b-4984-b444-5648f34487a0 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.633975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb847b356aa4788a94b96b03f58cb29, user_id=b3f2b7d5d25944e5a970fad1ee136f77, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.636737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.640651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 863/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:28:17.654693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 883/1746] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:17 2022] PUT /identity/v3/projects/2cb847b356aa4788a94b96b03f58cb29/users/b3f2b7d5d25944e5a970fad1ee136f77/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:17.656482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.656766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.657041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.680150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:17.681437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:17.779519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 864/1747] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:17.812727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.953770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36433355-a2d0-4e49-bbff-c4efa74b954b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:17.969602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:17.970239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:17.970518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:17.971024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:17.983691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:17.988837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:17.993052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:17.994630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:18.005624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 884/1748] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:18.014252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3895c0-2430-498e-ba89-b94938f809a4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:18.033001 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:18.033954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:18.034332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:18.034493 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] PATH_INFO: `/v3/projects/0120e9d75cce4caba68481c9f83f713a` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:18.036110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0120e9d75cce4caba68481c9f83f713a)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:18.038168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:18.107047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:18.110859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0120e9d75cce4caba68481c9f83f713a', 'request_id': 'req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.119209 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0120e9d75cce4caba68481c9f83f713a', 'request_id': 'req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.128724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0120e9d75cce4caba68481c9f83f713a', 'request_id': 'req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.157495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] The token cache is being invalidate because project 0120e9d75cce4caba68481c9f83f713a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:18.158430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.159275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.164937 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 865/1749] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:17 2022] DELETE /identity/v3/projects/0120e9d75cce4caba68481c9f83f713a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:18.166078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:18.177521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec3e2-0752-4e26-b012-21c00093db17 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:18.253100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:18.253800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:18.254355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:18.254776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] PATH_INFO: `/v3/users/d80ce34064f74f3ca651e2704224ab42` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:18.256800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80ce34064f74f3ca651e2704224ab42)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:18.260277 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:18.304840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:18.330942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80ce34064f74f3ca651e2704224ab42'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.357651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80ce34064f74f3ca651e2704224ab42'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.358416 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80ce34064f74f3ca651e2704224ab42'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.359071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80ce34064f74f3ca651e2704224ab42'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.369352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-d9e2fbf6-b7c3-40ea-a27f-135e7abe3238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80ce34064f74f3ca651e2704224ab42'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:18.398871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 885/1750] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:18 2022] DELETE /identity/v3/users/d80ce34064f74f3ca651e2704224ab42 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:18.793931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:18.799723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:18.839388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97fd9-337b-4ca8-a76f-1ecbc1dcd1b8 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:18.946561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:18.947241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:18.947522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:18.947795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] PATH_INFO: `/v3/projects/eba8e4c00ab348888e0b0adb486fc8a4` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:18.948969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba8e4c00ab348888e0b0adb486fc8a4)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:18.950905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:19.009699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba8e4c00ab348888e0b0adb486fc8a4', 'request_id': 'req-d9dc7f63-577b-4d83-904d-72ee8661fac0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:19.036428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba8e4c00ab348888e0b0adb486fc8a4', 'request_id': 'req-d9dc7f63-577b-4d83-904d-72ee8661fac0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:19.045260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba8e4c00ab348888e0b0adb486fc8a4', 'request_id': 'req-d9dc7f63-577b-4d83-904d-72ee8661fac0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:19.059352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] The token cache is being invalidate because project eba8e4c00ab348888e0b0adb486fc8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:19.060641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:19.062181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d9dc7f63-577b-4d83-904d-72ee8661fac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:19.066291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 866/1751] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:18 2022] DELETE /identity/v3/projects/eba8e4c00ab348888e0b0adb486fc8a4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:19.072630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95c30-d83c-4eb8-8ff5-6ac48e9c5949 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.072944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95c30-d83c-4eb8-8ff5-6ac48e9c5949 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.073196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95c30-d83c-4eb8-8ff5-6ac48e9c5949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.123153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-64e95c30-d83c-4eb8-8ff5-6ac48e9c5949 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:19.124406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-64e95c30-d83c-4eb8-8ff5-6ac48e9c5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:19.300495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 886/1752] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:19.310425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a4f7-efed-437c-910f-541abb3c79c8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.311811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a4f7-efed-437c-910f-541abb3c79c8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.312260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a4f7-efed-437c-910f-541abb3c79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.381339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5400a4f7-efed-437c-910f-541abb3c79c8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:19.384462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5400a4f7-efed-437c-910f-541abb3c79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:19.396203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 867/1753] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:19.400381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95c30-d83c-4eb8-8ff5-6ac48e9c5949 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:19.415251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95c30-d83c-4eb8-8ff5-6ac48e9c5949 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:19.427768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43711ac5-a81b-486d-be06-771e44ebdee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:19.429538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711ac5-a81b-486d-be06-771e44ebdee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.430049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711ac5-a81b-486d-be06-771e44ebdee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.430527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711ac5-a81b-486d-be06-771e44ebdee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.432132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711ac5-a81b-486d-be06-771e44ebdee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:19.432909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711ac5-a81b-486d-be06-771e44ebdee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:19.438699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711ac5-a81b-486d-be06-771e44ebdee8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:19.481258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 887/1754] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:19.481520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a4f7-efed-437c-910f-541abb3c79c8 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:19.495806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a4f7-efed-437c-910f-541abb3c79c8 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:19.510301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:19.511085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.511435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.512135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.512515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:19.541449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.541739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.542894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.547134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:19.604883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] MFA Rules not processed for user `b3f2b7d5d25944e5a970fad1ee136f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:19.607607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:19.647063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 868/1755] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:19 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:19.648048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:19.697512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:19.762158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee7ac-7044-4de1-bc6c-aa53437f044c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:19.768987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:19.769778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.770164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.770499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.771340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:19.773562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:19.777280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 888/1756] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:19.788821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:19.790697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:19.807207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 869/1757] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:19 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:19.811215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:19.824162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955a9a0-0b53-4d61-9015-3d76c55a6c7d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:19.829587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:19.830341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.830846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.831185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.832413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:19.833656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:19.853928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:19.869363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 870/1758] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:19.870915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:19.893628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038c4a-c5a3-4422-a0eb-d95f14ef5301 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:19.907378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:19.908296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.908645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.909210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:19.909865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:19.914185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:19.927238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 871/1759] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:19.933823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:19.939895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296857e1-89fd-4c93-b76c-942a3c19180f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:19.959127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c29015-3914-4a57-9c61-4c80899d0001 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:19.967130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a85dc-a4d7-4aa6-bc69-a0405462ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:19.967824 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a85dc-a4d7-4aa6-bc69-a0405462ce05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:19.968539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a85dc-a4d7-4aa6-bc69-a0405462ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:19.968855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a85dc-a4d7-4aa6-bc69-a0405462ce05 admin admin] PATH_INFO: `/v3/projects/36ce56af678c498cb1d7be3550c62336/users/7258c516798044ceb0fea01313f2ab11/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:20.004022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a85dc-a4d7-4aa6-bc69-a0405462ce05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ce56af678c498cb1d7be3550c62336, user_id=7258c516798044ceb0fea01313f2ab11, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:20.006919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a85dc-a4d7-4aa6-bc69-a0405462ce05 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:20.042916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 872/1760] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:19 2022] PUT /identity/v3/projects/36ce56af678c498cb1d7be3550c62336/users/7258c516798044ceb0fea01313f2ab11/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:20.049023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:20.049376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:20.049646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:20.068146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a2d2-1f1f-4141-b28a-b5c8fc5c62b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:20.069084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a2d2-1f1f-4141-b28a-b5c8fc5c62b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:20.069475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a2d2-1f1f-4141-b28a-b5c8fc5c62b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:20.070102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a2d2-1f1f-4141-b28a-b5c8fc5c62b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:20.093028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] MFA Rules not processed for user `7258c516798044ceb0fea01313f2ab11`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:20.094320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:20.207682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a2d2-1f1f-4141-b28a-b5c8fc5c62b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:20.209149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a2d2-1f1f-4141-b28a-b5c8fc5c62b6 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:20.211639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 873/1761] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:20.235855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 889/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:28:20.302145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:20.304032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:20.391644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc58b8-8462-41a0-b750-0b568c397b3b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:20.395596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:20.396462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:20.396740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:20.397010 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:20.407480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:20.409543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:20.420742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 874/1763] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:22.029894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e265137-4159-430c-97ef-b725c113693a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:22.030431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e265137-4159-430c-97ef-b725c113693a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:22.030431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e265137-4159-430c-97ef-b725c113693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:22.067535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-9e265137-4159-430c-97ef-b725c113693a None None] MFA Rules not processed for user `b3f2b7d5d25944e5a970fad1ee136f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:22.069172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9e265137-4159-430c-97ef-b725c113693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:22.169565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 890/1764] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:24.917158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:24.923531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:24.939035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:25.063385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb47c47-ab5d-490c-acc0-a4e30995c721 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:25.071417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:25.073115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:25.073399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:25.073669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] PATH_INFO: `/v3/users/fbdb5a17211646d8a73b6bb5f686c9d6` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:25.075295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdb5a17211646d8a73b6bb5f686c9d6)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:25.081341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:25.156646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdb5a17211646d8a73b6bb5f686c9d6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:25.172069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdb5a17211646d8a73b6bb5f686c9d6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:25.172867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdb5a17211646d8a73b6bb5f686c9d6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:25.173608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdb5a17211646d8a73b6bb5f686c9d6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:25.184679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdb5a17211646d8a73b6bb5f686c9d6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:25.219679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 875/1765] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:24 2022] DELETE /identity/v3/users/fbdb5a17211646d8a73b6bb5f686c9d6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:25.221821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:25.222337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:25.222413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:25.244922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:25.246357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:25.300747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:25.362498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 891/1766] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:25.387434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:25.388737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:25.468925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecd1a5-cae8-45b8-8c33-6c3f2d669e91 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:25.486020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa368585-4a8f-4b37-a8aa-99883683bc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:25.486848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368585-4a8f-4b37-a8aa-99883683bc76 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:25.487199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368585-4a8f-4b37-a8aa-99883683bc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:25.488789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368585-4a8f-4b37-a8aa-99883683bc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:25.499663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368585-4a8f-4b37-a8aa-99883683bc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:25.501313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368585-4a8f-4b37-a8aa-99883683bc76 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:25.516991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 876/1767] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:26.273966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:26.275534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:26.290405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bfc33-be95-4b3e-a209-d5940417a6f6 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:26.296183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:26.297081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.297557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.298020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] PATH_INFO: `/v3/projects/28ad96bcfe164c2e8ea7c1403818d3e8` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.299473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ad96bcfe164c2e8ea7c1403818d3e8)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:26.302549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:26.372954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ad96bcfe164c2e8ea7c1403818d3e8', 'request_id': 'req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:26.383509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ad96bcfe164c2e8ea7c1403818d3e8', 'request_id': 'req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:26.396846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ad96bcfe164c2e8ea7c1403818d3e8', 'request_id': 'req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:26.420422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] The token cache is being invalidate because project 28ad96bcfe164c2e8ea7c1403818d3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:26.421140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:26.422510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2bbd120b-9a3c-40af-882b-c71cdaa84cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:26.425856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 892/1768] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:26 2022] DELETE /identity/v3/projects/28ad96bcfe164c2e8ea7c1403818d3e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:26.430580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559791-613c-451f-9b2f-30e301dad413 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.431119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559791-613c-451f-9b2f-30e301dad413 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.431212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559791-613c-451f-9b2f-30e301dad413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.457943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b6559791-613c-451f-9b2f-30e301dad413 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:26.459227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b6559791-613c-451f-9b2f-30e301dad413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:26.485480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:26.558778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 877/1769] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:26.561380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626a028-c806-43ba-9fbe-2bd9c2e8e20a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.561670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626a028-c806-43ba-9fbe-2bd9c2e8e20a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.561960 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626a028-c806-43ba-9fbe-2bd9c2e8e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.587993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5626a028-c806-43ba-9fbe-2bd9c2e8e20a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:26.589418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5626a028-c806-43ba-9fbe-2bd9c2e8e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:26.599096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 893/1770] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:26.603877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6559791-613c-451f-9b2f-30e301dad413 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:26.617056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6559791-613c-451f-9b2f-30e301dad413 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:26.621992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:26.622400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.622782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.623090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.623747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:26.624049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:26.625660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:26.639510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 878/1771] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:26.645199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626a028-c806-43ba-9fbe-2bd9c2e8e20a None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:26.655819 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626a028-c806-43ba-9fbe-2bd9c2e8e20a None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:26.663375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:26.663375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.663808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.663924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.665140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:26.667015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:26.703191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 894/1772] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:26 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:26.704658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:26.715846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54e732-0a67-4b14-a904-b8cdbfcfae82 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:26.784167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:26.785148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.785622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.785896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.786537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:26.788517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:26.814856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 879/1773] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:26 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:26.818952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:26.830428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67222bd9-dada-45f0-b856-cc0b941e3dea admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:26.835007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:26.835749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.836096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.836432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.837501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:26.839504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:26.852858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 895/1774] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:26.854423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:26.865484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93bd77-8336-477e-bc59-c788acad22bf admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:26.871030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c26981-fcb0-40c4-80fe-b3852e3616a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:26.871346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c26981-fcb0-40c4-80fe-b3852e3616a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.871700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c26981-fcb0-40c4-80fe-b3852e3616a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.872044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c26981-fcb0-40c4-80fe-b3852e3616a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.872776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c26981-fcb0-40c4-80fe-b3852e3616a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:26.874496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c26981-fcb0-40c4-80fe-b3852e3616a2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:26.890224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 880/1775] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:26.891422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:26.902944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6254e-16cf-47c3-b7f7-f30324757f50 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:26.908310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:26.909105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.909445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.909720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] PATH_INFO: `/v3/projects/244002836a4645b1bf187b4dd273ab29/users/0b9a958c271341e0a473f800b7524eeb/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.933220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244002836a4645b1bf187b4dd273ab29, user_id=0b9a958c271341e0a473f800b7524eeb, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:26.935886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:26.952318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 896/1776] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:26 2022] PUT /identity/v3/projects/244002836a4645b1bf187b4dd273ab29/users/0b9a958c271341e0a473f800b7524eeb/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:26.957747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc05eb-9737-4d78-b978-f6f6a7ac475e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:26.958030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc05eb-9737-4d78-b978-f6f6a7ac475e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:26.958362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc05eb-9737-4d78-b978-f6f6a7ac475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:26.981108 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d8fc05eb-9737-4d78-b978-f6f6a7ac475e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:26.982326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d8fc05eb-9737-4d78-b978-f6f6a7ac475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:27.047787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 881/1777] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:27.058483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:27.060364 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:27.141447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f14b1e-808d-4d6a-9a74-42a7ff3e2291 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:27.145229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911875ca-e23d-4a63-9c23-a0541644eeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:27.145886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911875ca-e23d-4a63-9c23-a0541644eeff service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:27.146161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911875ca-e23d-4a63-9c23-a0541644eeff service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:27.146430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911875ca-e23d-4a63-9c23-a0541644eeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:27.156937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911875ca-e23d-4a63-9c23-a0541644eeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:27.159259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911875ca-e23d-4a63-9c23-a0541644eeff service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:27.183275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 897/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:32.962448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372f525-8598-4401-a14a-ceec2ebe53ef None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:32.963132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372f525-8598-4401-a14a-ceec2ebe53ef None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:32.963709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372f525-8598-4401-a14a-ceec2ebe53ef None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:32.965527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 882/1779] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:28:32.978922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46286e16-e355-4f7f-aa72-c1326d6da178 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:32.981328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46286e16-e355-4f7f-aa72-c1326d6da178 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:32.982405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46286e16-e355-4f7f-aa72-c1326d6da178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:32.995114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:33.019524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-46286e16-e355-4f7f-aa72-c1326d6da178 None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:33.021376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-46286e16-e355-4f7f-aa72-c1326d6da178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:33.136304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 898/1780] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:28:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:33.148773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372f525-8598-4401-a14a-ceec2ebe53ef None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:33.150699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2372f525-8598-4401-a14a-ceec2ebe53ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:33.168168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372f525-8598-4401-a14a-ceec2ebe53ef None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:33.175193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:33.176633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:33.177072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:33.177500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] PATH_INFO: `/v3/users/e1087a14fa6343c680c16d9456d96ce7` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:33.179004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1087a14fa6343c680c16d9456d96ce7)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:33.181463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:33.183477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ced71c-d422-4413-8b6d-b8d9e669c07d None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:33.184228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ced71c-d422-4413-8b6d-b8d9e669c07d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:33.184603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ced71c-d422-4413-8b6d-b8d9e669c07d None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:33.186860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 899/1781] 10.222.0.16 () {54 vars in 961 bytes} [Tue Oct 11 13:28:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:28:33.194878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fb086-5cb6-437f-902f-7f4f2ff30f47 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:33.195468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fb086-5cb6-437f-902f-7f4f2ff30f47 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:33.195923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fb086-5cb6-437f-902f-7f4f2ff30f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:33.225970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:33.226553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a10fb086-5cb6-437f-902f-7f4f2ff30f47 None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:33.228594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a10fb086-5cb6-437f-902f-7f4f2ff30f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:33.245827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 900/1782] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Oct 11 13:28:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:33.258595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fb086-5cb6-437f-902f-7f4f2ff30f47 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:33.272461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fb086-5cb6-437f-902f-7f4f2ff30f47 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:33.279891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1087a14fa6343c680c16d9456d96ce7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.281886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:33.282779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:33.283576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:33.284090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:33.295872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:33.297311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1087a14fa6343c680c16d9456d96ce7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.299074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:33.302302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1087a14fa6343c680c16d9456d96ce7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.302961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1087a14fa6343c680c16d9456d96ce7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.320063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-47df4486-0566-4158-8bda-2be18958b061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1087a14fa6343c680c16d9456d96ce7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.328916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 901/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:33.360248 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 883/1784] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:33 2022] DELETE /identity/v3/users/e1087a14fa6343c680c16d9456d96ce7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:33.622036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:33.636674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7445133-50f7-45ed-886f-92177155a340 service placement] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:33.737601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:33.738494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:33.738745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:33.739120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] PATH_INFO: `/v3/projects/0b45ac84da64465c82b415c62650c3c4` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:33.740763 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b45ac84da64465c82b415c62650c3c4)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:33.743265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:33.832644 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b45ac84da64465c82b415c62650c3c4', 'request_id': 'req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.842059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b45ac84da64465c82b415c62650c3c4', 'request_id': 'req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.853492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b45ac84da64465c82b415c62650c3c4', 'request_id': 'req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.866582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] The token cache is being invalidate because project 0b45ac84da64465c82b415c62650c3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:33.867107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.867882 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c716fab2-afdc-4c70-93c6-cfeb4fe5bbd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:33.869742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 902/1785] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:33 2022] DELETE /identity/v3/projects/0b45ac84da64465c82b415c62650c3c4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:33.875283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8ded7-0683-46a3-a569-a2abc56c5d54 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:33.875390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8ded7-0683-46a3-a569-a2abc56c5d54 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:33.875785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8ded7-0683-46a3-a569-a2abc56c5d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:33.898614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a8a8ded7-0683-46a3-a569-a2abc56c5d54 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:33.899970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a8a8ded7-0683-46a3-a569-a2abc56c5d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:33.984684 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 884/1786] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:33.993240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c45bf9-5382-4fca-818c-7e1251e56dc9 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:33.993646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c45bf9-5382-4fca-818c-7e1251e56dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:33.993821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c45bf9-5382-4fca-818c-7e1251e56dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.028264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-65c45bf9-5382-4fca-818c-7e1251e56dc9 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:34.029607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-65c45bf9-5382-4fca-818c-7e1251e56dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:34.043970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 903/1787] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:34.045810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8ded7-0683-46a3-a569-a2abc56c5d54 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.056244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8ded7-0683-46a3-a569-a2abc56c5d54 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.062236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.063231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.063710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.064330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.065173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:34.065668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.067941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.086648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 885/1788] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:34.095573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c45bf9-5382-4fca-818c-7e1251e56dc9 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.101363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:34.116486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c45bf9-5382-4fca-818c-7e1251e56dc9 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.144768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.149347 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.150017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.157286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.158501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.168087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.210884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 904/1789] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:34 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:34.214181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.233731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac259-2600-4c85-9c1f-9a8eea024c74 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.333800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.335537 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.335986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.337966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.338801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.345216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.374966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 886/1790] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:34 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:34.378086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.389624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd235-2418-4748-bf6b-79bd8f2fd7dc admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.396532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.397545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.397994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.398409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.399399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.401378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.417554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 905/1791] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:34.419062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.431845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e44b-3aad-4013-b289-492776d36e27 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.437025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05560ed2-262a-4469-a4b1-59be9c730dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.437956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05560ed2-262a-4469-a4b1-59be9c730dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.438406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05560ed2-262a-4469-a4b1-59be9c730dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.438890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05560ed2-262a-4469-a4b1-59be9c730dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.439981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05560ed2-262a-4469-a4b1-59be9c730dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.442090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05560ed2-262a-4469-a4b1-59be9c730dcd admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.459385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 887/1792] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:34.463577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.475821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d63903-88ce-4aa8-b95c-1392bd753692 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.483417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.484214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.484683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.485044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] PATH_INFO: `/v3/projects/ce7d535d04ce4941b63964522a34dac2/users/2ed65063f8124dfb9adb49200799926b/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.505981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7d535d04ce4941b63964522a34dac2, user_id=2ed65063f8124dfb9adb49200799926b, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.510244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.535547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 906/1793] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:34 2022] PUT /identity/v3/projects/ce7d535d04ce4941b63964522a34dac2/users/2ed65063f8124dfb9adb49200799926b/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:34.548747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.549321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.549766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.575422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:34.584741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] MFA Rules not processed for user `2ed65063f8124dfb9adb49200799926b`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:34.587835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:34.677445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 888/1794] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:34.677598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.752400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.754046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:34.848647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6786a-c057-4419-8bc7-369df18ca5fc admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.862153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.863069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.863443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.864302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.865057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.867631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.870809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f07495-2d03-4e7a-bacf-32b50e844e05 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:34.890692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:34.891364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:34.891644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:34.892205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] PATH_INFO: `/v3/users/7258c516798044ceb0fea01313f2ab11` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:34.893784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7258c516798044ceb0fea01313f2ab11)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:34.896527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:34.923271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 907/1795] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:34 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:34.928305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:34.980952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7258c516798044ceb0fea01313f2ab11'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:34.996353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7258c516798044ceb0fea01313f2ab11'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:34.998633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7258c516798044ceb0fea01313f2ab11'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.000138 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7258c516798044ceb0fea01313f2ab11'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.012196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c7193861-2d53-49fd-8ab6-f5f99a53b13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7258c516798044ceb0fea01313f2ab11'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.029537 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa55e8-5307-4729-b848-bc957a9f75aa admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.036532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.037198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.037681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.037967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.039611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.042235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.050404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 889/1796] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:34 2022] DELETE /identity/v3/users/7258c516798044ceb0fea01313f2ab11 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:35.055320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.055605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.056127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.084074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:35.085432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.097142 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 908/1797] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:34 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:35.101969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.106676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.116142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:35.124607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e7e8-d3cc-4946-938f-3d6d98628f82 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.149987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:35.191737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 890/1798] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:35.203341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.206513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.226037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.227274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.227630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.227972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.228872 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.230806 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.243703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 909/1799] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:35.247454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.263078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5a4c3-ea35-468d-8fbf-fd471f9f9587 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.273405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad502f0-1217-4700-99b0-88a63be2db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.274537 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad502f0-1217-4700-99b0-88a63be2db90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.276684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad502f0-1217-4700-99b0-88a63be2db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.277361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad502f0-1217-4700-99b0-88a63be2db90 admin admin] PATH_INFO: `/v3/projects/6ebc2b05166f40138a85c0750ce02c41/users/cd3e80d623ab4a578d442edc2c886f33/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.287600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732c68-7b7d-4466-997a-9f706cccdaa5 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.291429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.292192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.292467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.293074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.303310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad502f0-1217-4700-99b0-88a63be2db90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebc2b05166f40138a85c0750ce02c41, user_id=cd3e80d623ab4a578d442edc2c886f33, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.304769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.306385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.307032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad502f0-1217-4700-99b0-88a63be2db90 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.318393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 891/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:35.339840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 910/1801] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:35 2022] PUT /identity/v3/projects/6ebc2b05166f40138a85c0750ce02c41/users/cd3e80d623ab4a578d442edc2c886f33/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:35.343785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.356361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e42b8-9531-4973-814d-ca339220c873 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.427692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.428395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.428679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.428949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.429804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.431271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.434782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.435109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.435386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.444053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 892/1802] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:35.448080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.461231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ac6fc-6d68-4edb-899e-5b80f075518a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.467594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b0974-fb5b-42d8-bf14-c07f523e27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.468959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] MFA Rules not processed for user `0b9a958c271341e0a473f800b7524eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:35.470524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0974-fb5b-42d8-bf14-c07f523e27ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.470920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0974-fb5b-42d8-bf14-c07f523e27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.471388 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0974-fb5b-42d8-bf14-c07f523e27ea admin admin] PATH_INFO: `/v3/projects/6ebc2b05166f40138a85c0750ce02c41/users/cd3e80d623ab4a578d442edc2c886f33/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.472845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.476876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b0974-fb5b-42d8-bf14-c07f523e27ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebc2b05166f40138a85c0750ce02c41, user_id=cd3e80d623ab4a578d442edc2c886f33, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.482052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b0974-fb5b-42d8-bf14-c07f523e27ea admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.503512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 893/1803] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:35 2022] PUT /identity/v3/projects/6ebc2b05166f40138a85c0750ce02c41/users/cd3e80d623ab4a578d442edc2c886f33/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:35.520658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.520943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.521212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.568081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] MFA Rules not processed for user `cd3e80d623ab4a578d442edc2c886f33`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:35.570065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.577828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 911/1804] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:35.578757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.596407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.625518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:35.630128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016dbb-e351-4198-b07b-a3a18f2c7b25 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.685677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 894/1805] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:35.694384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.696561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.725048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.725744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.726800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.727323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.728116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.731292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.770341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 912/1806] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:35 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:35.771308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.772860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.779423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41c835-c1f0-421b-9941-3de1faf90a2e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.781951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:35.834719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.835654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.835999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.836278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.838513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.843972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720432-46e1-4c7d-9f59-2ce7aee557cf admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.850140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:35.850787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.851098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.851397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] PATH_INFO: `/v3/projects/36ce56af678c498cb1d7be3550c62336` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.852515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ce56af678c498cb1d7be3550c62336)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.854433 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.906224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:35.907704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:35.912665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ce56af678c498cb1d7be3550c62336', 'request_id': 'req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.917969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 895/1807] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:28:35.919906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:35.922337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ce56af678c498cb1d7be3550c62336', 'request_id': 'req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.930281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ce56af678c498cb1d7be3550c62336', 'request_id': 'req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.933776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e31ea-7a3f-4352-9ad5-2aa7fcfb670f service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:35.941482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] The token cache is being invalidate because project 36ce56af678c498cb1d7be3550c62336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:35.941705 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.942529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-584a90b2-f44f-4d8b-a2f8-a1f9a9feeac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:35.945843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 913/1808] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:35 2022] DELETE /identity/v3/projects/36ce56af678c498cb1d7be3550c62336 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:35.950874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98787b-cd15-4ca3-a975-0989c6844ecc None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:35.951180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98787b-cd15-4ca3-a975-0989c6844ecc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:35.951505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98787b-cd15-4ca3-a975-0989c6844ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:35.979074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-be98787b-cd15-4ca3-a975-0989c6844ecc None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:35.980294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-be98787b-cd15-4ca3-a975-0989c6844ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:35.988568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:36.027342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.028041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.028255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.028527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.029229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.031432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.062065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 896/1809] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:35 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:36.072908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 914/1810] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:36.074095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.075838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38103f4b-c367-4cb4-940f-d7e9b60d0f18 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.076172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38103f4b-c367-4cb4-940f-d7e9b60d0f18 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.076439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38103f4b-c367-4cb4-940f-d7e9b60d0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.080007 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:36.100120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117832f-5c1b-40d2-9a0c-eedf8ae52563 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.106778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.107538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.107817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.108088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.108875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.110751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.116566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-38103f4b-c367-4cb4-940f-d7e9b60d0f18 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:36.118784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-38103f4b-c367-4cb4-940f-d7e9b60d0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:36.124361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 897/1811] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:36.128888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.130428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 915/1812] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:36.135860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38103f4b-c367-4cb4-940f-d7e9b60d0f18 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.149960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b770a-e2ba-41cc-9bdd-6d2770984860 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.166185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38103f4b-c367-4cb4-940f-d7e9b60d0f18 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.177748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.179723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.180073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.180355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] PATH_INFO: `/v3/projects/4956eeaa940545bd93b6642190d2efad/users/9499fdf81cb6418eb3a56a7fb35691e6/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.185563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.185784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.186152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.186435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.187568 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:36.187953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.191919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.211297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4956eeaa940545bd93b6642190d2efad, user_id=9499fdf81cb6418eb3a56a7fb35691e6, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.216059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.232319 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 916/1813] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:36.236597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.250496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 898/1814] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:36 2022] PUT /identity/v3/projects/4956eeaa940545bd93b6642190d2efad/users/9499fdf81cb6418eb3a56a7fb35691e6/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:36.253092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.266151 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432efcfb-b76b-4089-ba8f-a032b332b278 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.344335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:36.472159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.474013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019caff-0b8c-4a26-bd80-77ea1e3364c8 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.474981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.475764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.476158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.478474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.484767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.500742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.501398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.501818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.502172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.503824 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.505477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.530988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 899/1815] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:36.535685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.559048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420ce61-8908-49c9-9022-2889aa9e38b3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.565262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.565972 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.566256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.566535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] PATH_INFO: `/v3/projects/4956eeaa940545bd93b6642190d2efad/users/9499fdf81cb6418eb3a56a7fb35691e6/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.579104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4956eeaa940545bd93b6642190d2efad, user_id=9499fdf81cb6418eb3a56a7fb35691e6, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.579448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 917/1816] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:36 2022] POST /identity/v3/projects => generated 363 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:36.579552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.580825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.605083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 900/1817] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:36 2022] PUT /identity/v3/projects/4956eeaa940545bd93b6642190d2efad/users/9499fdf81cb6418eb3a56a7fb35691e6/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:36.709303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6478-8825-48d8-bfdb-c2ae0356ceb4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.789702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.791356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.792282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.793201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.794988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.798466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.856333 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 918/1818] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:36 2022] POST /identity/v3/users => generated 282 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:36.860447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.875571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa193-715b-414d-936e-3cbc9d8ecdb4 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.882233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.883062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.883474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.883862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.884636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.886552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.899414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 901/1819] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:36.904579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.917176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d578-fc32-4545-9b9d-ff2147e46dfb admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.924934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1929f49-0819-4d16-a86c-a9b2762edfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.925727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929f49-0819-4d16-a86c-a9b2762edfdf admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.926146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929f49-0819-4d16-a86c-a9b2762edfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.926517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929f49-0819-4d16-a86c-a9b2762edfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:36.927417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1929f49-0819-4d16-a86c-a9b2762edfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:36.929259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1929f49-0819-4d16-a86c-a9b2762edfdf admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:36.944092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 919/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:28:36.947935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:36.963285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df341e8-afdf-4e31-8079-2148a98d3b8b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:36.979364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:36.980069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:36.981149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:36.981432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] PATH_INFO: `/v3/projects/08c88b0f839a4deab66cf6a5a84f8e84/users/2d51260174164ebc86fae9feed1f50e7/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:37.029331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c88b0f839a4deab66cf6a5a84f8e84, user_id=2d51260174164ebc86fae9feed1f50e7, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:37.036336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:37.058624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 902/1821] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:36 2022] PUT /identity/v3/projects/08c88b0f839a4deab66cf6a5a84f8e84/users/2d51260174164ebc86fae9feed1f50e7/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:37.070061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:37.070526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:37.070671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:37.186088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] MFA Rules not processed for user `2d51260174164ebc86fae9feed1f50e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:37.187514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:37.218185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:37.327457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 920/1822] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:37.340770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:37.345162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:37.459687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:37.503574 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e05028-0b05-4f22-9a96-905035d50eb3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:37.509010 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:37.509731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:37.509965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:37.510831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:37.525199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:37.527599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:37.539635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 903/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:38.955640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:38.957843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:38.972991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d547500-b6d1-4e33-bb77-6da27b08da9c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:38.986658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55d0c9-94da-47ff-bfd4-edaaaac741a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:38.987685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d0c9-94da-47ff-bfd4-edaaaac741a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:38.988759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d0c9-94da-47ff-bfd4-edaaaac741a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:38.990084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55d0c9-94da-47ff-bfd4-edaaaac741a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:39.000769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3f55d0c9-94da-47ff-bfd4-edaaaac741a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:39.082986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:39.098074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16ca50-267f-438a-8f9e-f5bfc7cd35b2 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:39.103334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:39.104511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:39.104901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:39.105321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:39.108813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:39.137696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55d0c9-94da-47ff-bfd4-edaaaac741a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:39.139869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55d0c9-94da-47ff-bfd4-edaaaac741a9 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:39.164839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 921/1824] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:39.295851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:39.299657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:39.324679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 904/1825] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:43.119800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50788-4f87-4570-9446-b20ec2d8f59a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:43.120364 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50788-4f87-4570-9446-b20ec2d8f59a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:43.120459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50788-4f87-4570-9446-b20ec2d8f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:43.157176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bbb50788-4f87-4570-9446-b20ec2d8f59a None None] MFA Rules not processed for user `9499fdf81cb6418eb3a56a7fb35691e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:43.159169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bbb50788-4f87-4570-9446-b20ec2d8f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:43.249515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 922/1826] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:43.265207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:43.268711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:43.352871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844db66-d483-4bd8-9e65-de945115596c service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:43.362014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5a558-cd06-47f8-8d53-c4f6e64885e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:43.362826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a558-cd06-47f8-8d53-c4f6e64885e5 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:43.363145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a558-cd06-47f8-8d53-c4f6e64885e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:43.363509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a558-cd06-47f8-8d53-c4f6e64885e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:43.365370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-10c5a558-cd06-47f8-8d53-c4f6e64885e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:43.431909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5a558-cd06-47f8-8d53-c4f6e64885e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:43.433528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5a558-cd06-47f8-8d53-c4f6e64885e5 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:43.443787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 905/1827] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:45.231768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:45.232390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:45.232390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:45.263265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] MFA Rules not processed for user `0b9a958c271341e0a473f800b7524eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:45.264540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:45.274368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 923/1828] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:48.719776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816473-93d8-4a3b-a571-f22e019858e3 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:48.720317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816473-93d8-4a3b-a571-f22e019858e3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:48.720317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816473-93d8-4a3b-a571-f22e019858e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:48.744038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6a816473-93d8-4a3b-a571-f22e019858e3 None None] MFA Rules not processed for user `b3f2b7d5d25944e5a970fad1ee136f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:48.745673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6a816473-93d8-4a3b-a571-f22e019858e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:48.760476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:48.810197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 906/1829] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:53.155550 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:53.157269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:53.193259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:53.238890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb101ec8-e1ce-4199-94f3-dfcaf9eacc85 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:53.238890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:53.238890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:53.238890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:53.239326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] PATH_INFO: `/v3/users/2ed65063f8124dfb9adb49200799926b` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:53.239326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed65063f8124dfb9adb49200799926b)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:53.239326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:53.285167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed65063f8124dfb9adb49200799926b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.291814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed65063f8124dfb9adb49200799926b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.292460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed65063f8124dfb9adb49200799926b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.293396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed65063f8124dfb9adb49200799926b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.302409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed65063f8124dfb9adb49200799926b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.327420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 924/1830] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:53 2022] DELETE /identity/v3/users/2ed65063f8124dfb9adb49200799926b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:53.332198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:53.332683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:53.332804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:53.353081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:53.354295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:53.417652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 907/1831] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:53.429543 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:53.431171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:53.490887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396d4c-226b-434b-8c17-c869a53f9039 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:53.497154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:53.497848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:53.498332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:53.498707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:53.510542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:53.512032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:53.521987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 925/1832] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:53.836583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:53.838278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:53.852133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db058c-190e-4f11-a3d9-d2862fe4cf87 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:53.856898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:53.857543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:53.857820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:53.858612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] PATH_INFO: `/v3/projects/ce7d535d04ce4941b63964522a34dac2` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:53.859265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7d535d04ce4941b63964522a34dac2)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:53.861285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:53.934322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7d535d04ce4941b63964522a34dac2', 'request_id': 'req-939785b6-e763-4f2f-acc2-7884ac5468e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.942924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7d535d04ce4941b63964522a34dac2', 'request_id': 'req-939785b6-e763-4f2f-acc2-7884ac5468e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.949686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7d535d04ce4941b63964522a34dac2', 'request_id': 'req-939785b6-e763-4f2f-acc2-7884ac5468e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.961165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] The token cache is being invalidate because project ce7d535d04ce4941b63964522a34dac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:53.961627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.962341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:53.963963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 908/1833] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:53 2022] DELETE /identity/v3/projects/ce7d535d04ce4941b63964522a34dac2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:53.968072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:53.995283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4c91b-25df-4e50-9a84-e320cc074f67 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:54.074770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:54.103262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:54.104009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:54.104354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:54.104765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] PATH_INFO: `/v3/users/cd3e80d623ab4a578d442edc2c886f33` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:54.108517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3e80d623ab4a578d442edc2c886f33)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:54.110954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:54.163574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3e80d623ab4a578d442edc2c886f33'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.170172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3e80d623ab4a578d442edc2c886f33'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.170984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3e80d623ab4a578d442edc2c886f33'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.171644 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3e80d623ab4a578d442edc2c886f33'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.180582 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-8474fecd-ddee-4b8b-9c46-e9392e3616ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3e80d623ab4a578d442edc2c886f33'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.197765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 926/1834] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:53 2022] DELETE /identity/v3/users/cd3e80d623ab4a578d442edc2c886f33 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:54.481158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:54.482756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:54.497663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939785b6-e763-4f2f-acc2-7884ac5468e7 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:54.552906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:54.567099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:54.567771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:54.568085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:54.568374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] PATH_INFO: `/v3/projects/6ebc2b05166f40138a85c0750ce02c41` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:54.569600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebc2b05166f40138a85c0750ce02c41)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:54.571638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:54.617680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebc2b05166f40138a85c0750ce02c41', 'request_id': 'req-4be14b79-c39b-4bee-becc-f2982b456de6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.626159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebc2b05166f40138a85c0750ce02c41', 'request_id': 'req-4be14b79-c39b-4bee-becc-f2982b456de6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.633005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebc2b05166f40138a85c0750ce02c41', 'request_id': 'req-4be14b79-c39b-4bee-becc-f2982b456de6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.644008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] The token cache is being invalidate because project 6ebc2b05166f40138a85c0750ce02c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:54.644293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.644914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4be14b79-c39b-4bee-becc-f2982b456de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:54.646415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 909/1835] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:54 2022] DELETE /identity/v3/projects/6ebc2b05166f40138a85c0750ce02c41 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:54.651571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d416e2-4942-4003-9d31-c6fa99f9f18b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:54.651932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d416e2-4942-4003-9d31-c6fa99f9f18b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:54.652258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d416e2-4942-4003-9d31-c6fa99f9f18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:54.677630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e2d416e2-4942-4003-9d31-c6fa99f9f18b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:54.679378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e2d416e2-4942-4003-9d31-c6fa99f9f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:54.746805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 927/1836] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:54.755345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930461ab-80f6-4a4c-b6fb-ec89a55d7579 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:54.755607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930461ab-80f6-4a4c-b6fb-ec89a55d7579 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:54.755882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930461ab-80f6-4a4c-b6fb-ec89a55d7579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:54.779204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-930461ab-80f6-4a4c-b6fb-ec89a55d7579 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:54.780432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-930461ab-80f6-4a4c-b6fb-ec89a55d7579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:54.789996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 910/1837] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:54.794762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d416e2-4942-4003-9d31-c6fa99f9f18b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:54.804779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d416e2-4942-4003-9d31-c6fa99f9f18b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:54.810033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:54.810641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:54.810943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:54.811210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:54.811839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:54.812179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:54.813791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:54.826158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 928/1838] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:54.830832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930461ab-80f6-4a4c-b6fb-ec89a55d7579 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:54.840833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930461ab-80f6-4a4c-b6fb-ec89a55d7579 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:54.846890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:54.847520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:54.847796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:54.848065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:54.848764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:54.850705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:54.891785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 911/1839] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:54 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:54.893132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:54.903961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a041191-6643-4836-973c-ecf70d1e8768 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:54.963508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:54.964122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:54.964397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:54.964662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:54.965284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:54.967296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:54.975558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:54.995476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 929/1840] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:54 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:54.999418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.017998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e322f-6a07-4408-b79f-f411d81fef83 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.023067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.023702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.023985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.024259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.024907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.026543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.039399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 912/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:55.043827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.056668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54963fab-b3e9-4f9e-baed-ea1b9972cfb3 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.061876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a46bf-3657-4001-95a0-1181a6b40968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.062493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a46bf-3657-4001-95a0-1181a6b40968 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.062779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a46bf-3657-4001-95a0-1181a6b40968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.063050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a46bf-3657-4001-95a0-1181a6b40968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.063688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a46bf-3657-4001-95a0-1181a6b40968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.078112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a46bf-3657-4001-95a0-1181a6b40968 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.078112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 930/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:55.082644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.103594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f362a-2b6b-4df8-a2e5-7a9b5b5e458e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.108833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.109506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.109783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.110055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] PATH_INFO: `/v3/projects/523caf5446934677a263b83bd2007bc4/users/ffcc6a945b0a446481d2aff3d55168dd/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.126216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523caf5446934677a263b83bd2007bc4, user_id=ffcc6a945b0a446481d2aff3d55168dd, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.128929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.143507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 913/1843] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:55 2022] PUT /identity/v3/projects/523caf5446934677a263b83bd2007bc4/users/ffcc6a945b0a446481d2aff3d55168dd/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:55.157334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03fea7-19b6-4158-bf8f-9667b630cfbb None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.157615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03fea7-19b6-4158-bf8f-9667b630cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.157888 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03fea7-19b6-4158-bf8f-9667b630cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.188629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3a03fea7-19b6-4158-bf8f-9667b630cfbb None None] MFA Rules not processed for user `ffcc6a945b0a446481d2aff3d55168dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:55.189978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3a03fea7-19b6-4158-bf8f-9667b630cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:55.257010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 931/1844] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:55.260107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.368627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc10121-b5bb-4429-8a71-e25897121227 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.381606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.382443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.383034 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.383497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.384213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.386309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.408886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:55.416835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 914/1845] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:55 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:55.420927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03fea7-19b6-4158-bf8f-9667b630cfbb None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.432555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03fea7-19b6-4158-bf8f-9667b630cfbb None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.497201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.497875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.498155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.498423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.499113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.501527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.527809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 932/1846] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:55 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:55.529224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.539827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbe3db-23a2-4d5d-be36-221b77a17541 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.544968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.545536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.545817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.546091 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.546766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.548355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.559402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 915/1847] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:55.563916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.577304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86114e-06ea-46dd-90ee-d1edb6ddb87a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.582767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.583504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.583891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.584166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] PATH_INFO: `/v3/projects/770e562c08ef4ee6ba95881d176867c5/users/5ebd2480fb9e4a45985160021c51854f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.600623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e562c08ef4ee6ba95881d176867c5, user_id=5ebd2480fb9e4a45985160021c51854f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.603432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.619413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 933/1848] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:55 2022] PUT /identity/v3/projects/770e562c08ef4ee6ba95881d176867c5/users/5ebd2480fb9e4a45985160021c51854f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:55.623622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.633839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cd0b9-ecbc-4df2-844d-7b958a230a56 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.697379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb96a2-6a8d-493a-b0d3-842c8708164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.698222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb96a2-6a8d-493a-b0d3-842c8708164f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.698621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb96a2-6a8d-493a-b0d3-842c8708164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.698931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb96a2-6a8d-493a-b0d3-842c8708164f admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.699907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb96a2-6a8d-493a-b0d3-842c8708164f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.702170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb96a2-6a8d-493a-b0d3-842c8708164f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.716823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 916/1849] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:55.721193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.732367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4f88-2726-43f6-83f1-2bf552ea0774 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.737978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.738627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.738945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.739217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] PATH_INFO: `/v3/projects/770e562c08ef4ee6ba95881d176867c5/users/5ebd2480fb9e4a45985160021c51854f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.741316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e562c08ef4ee6ba95881d176867c5, user_id=5ebd2480fb9e4a45985160021c51854f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.743989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.755989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 934/1850] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:55 2022] PUT /identity/v3/projects/770e562c08ef4ee6ba95881d176867c5/users/5ebd2480fb9e4a45985160021c51854f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:55.766515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa8da-5ee7-4370-95c9-dd9dc71d1ccf None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.766774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa8da-5ee7-4370-95c9-dd9dc71d1ccf None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.767092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa8da-5ee7-4370-95c9-dd9dc71d1ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.796951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d97aa8da-5ee7-4370-95c9-dd9dc71d1ccf None None] MFA Rules not processed for user `5ebd2480fb9e4a45985160021c51854f`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:55.798059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d97aa8da-5ee7-4370-95c9-dd9dc71d1ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:55.868655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 917/1851] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:55.883942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:55.887095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:55.915661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:55.954504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa53e-d431-4c82-9a9e-1898930ead44 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:55.958601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55220686-bef0-4e69-a3a1-9f2976cf4312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:55.959313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55220686-bef0-4e69-a3a1-9f2976cf4312 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:55.959585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55220686-bef0-4e69-a3a1-9f2976cf4312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:55.959866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55220686-bef0-4e69-a3a1-9f2976cf4312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:55.969317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55220686-bef0-4e69-a3a1-9f2976cf4312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:55.970925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55220686-bef0-4e69-a3a1-9f2976cf4312 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:55.980675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 935/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:56.137012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aa8da-5ee7-4370-95c9-dd9dc71d1ccf None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:56.243175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aa8da-5ee7-4370-95c9-dd9dc71d1ccf None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:56.248676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:56.249429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:56.249729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:56.250011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] PATH_INFO: `/v3/users/ffcc6a945b0a446481d2aff3d55168dd` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:56.254675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcc6a945b0a446481d2aff3d55168dd)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:56.254675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:56.270928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:56.320416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcc6a945b0a446481d2aff3d55168dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:56.334851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcc6a945b0a446481d2aff3d55168dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:56.334851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcc6a945b0a446481d2aff3d55168dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:56.334851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcc6a945b0a446481d2aff3d55168dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:56.342285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcc6a945b0a446481d2aff3d55168dd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:56.360196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 918/1853] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:56 2022] DELETE /identity/v3/users/ffcc6a945b0a446481d2aff3d55168dd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:56.364761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:56.365490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:56.365490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:56.399275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:56.401153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:56.492864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 936/1854] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:56.505961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:56.507586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:56.603122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18388c-637b-4153-b41d-73a7223b8c7a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:56.610904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:56.612599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:56.613543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:56.613960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:56.633023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:56.635925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:56.657931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 919/1855] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:57.036857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:57.038565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:57.051895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800888-fb8a-4c83-8857-1d83ae828601 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:57.058351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:57.059054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:57.059330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:57.059594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] PATH_INFO: `/v3/projects/523caf5446934677a263b83bd2007bc4` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:57.061900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523caf5446934677a263b83bd2007bc4)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:57.063908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:57.114006 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523caf5446934677a263b83bd2007bc4', 'request_id': 'req-68fe050f-5ba2-44c1-b253-2af41d67d993'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.122257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523caf5446934677a263b83bd2007bc4', 'request_id': 'req-68fe050f-5ba2-44c1-b253-2af41d67d993'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.128942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523caf5446934677a263b83bd2007bc4', 'request_id': 'req-68fe050f-5ba2-44c1-b253-2af41d67d993'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.140700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] The token cache is being invalidate because project 523caf5446934677a263b83bd2007bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:57.140986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.141700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.143403 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 937/1856] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:57 2022] DELETE /identity/v3/projects/523caf5446934677a263b83bd2007bc4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:57.147805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:57.158092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e6f81-862d-4a89-a09c-054c8bcfc264 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:57.223498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:57.224319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:57.224600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:57.224869 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] PATH_INFO: `/v3/users/5ebd2480fb9e4a45985160021c51854f` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:57.226043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebd2480fb9e4a45985160021c51854f)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:57.227998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:57.263435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:57.276830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebd2480fb9e4a45985160021c51854f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.283581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebd2480fb9e4a45985160021c51854f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.284222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebd2480fb9e4a45985160021c51854f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.284803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebd2480fb9e4a45985160021c51854f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.294756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-23e1a1f2-6aec-4b85-aee4-e9c8bdc21dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebd2480fb9e4a45985160021c51854f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.311631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 920/1857] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:28:57 2022] DELETE /identity/v3/users/5ebd2480fb9e4a45985160021c51854f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:57.649748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:57.651304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:57.665188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe050f-5ba2-44c1-b253-2af41d67d993 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:57.716875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:57.731611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:57.732308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:57.732610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:57.733564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] PATH_INFO: `/v3/projects/770e562c08ef4ee6ba95881d176867c5` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:57.734784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770e562c08ef4ee6ba95881d176867c5)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:57.736756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:57.794922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770e562c08ef4ee6ba95881d176867c5', 'request_id': 'req-289dd00a-c16e-483e-ab11-18934fdf31f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.803518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770e562c08ef4ee6ba95881d176867c5', 'request_id': 'req-289dd00a-c16e-483e-ab11-18934fdf31f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.810470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770e562c08ef4ee6ba95881d176867c5', 'request_id': 'req-289dd00a-c16e-483e-ab11-18934fdf31f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.822762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] The token cache is being invalidate because project 770e562c08ef4ee6ba95881d176867c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:28:57.823075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.823748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-289dd00a-c16e-483e-ab11-18934fdf31f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:28:57.825469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 938/1858] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:28:57 2022] DELETE /identity/v3/projects/770e562c08ef4ee6ba95881d176867c5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:28:57.830280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044670c-2f08-4fcb-b989-9e43308d0e5a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:57.830774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044670c-2f08-4fcb-b989-9e43308d0e5a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:57.830971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044670c-2f08-4fcb-b989-9e43308d0e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:57.851127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-c044670c-2f08-4fcb-b989-9e43308d0e5a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:57.852361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c044670c-2f08-4fcb-b989-9e43308d0e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:57.938270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 921/1859] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:57.940599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73183f-17d4-4e48-aa0b-c2373730203f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:57.941202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73183f-17d4-4e48-aa0b-c2373730203f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:57.941828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73183f-17d4-4e48-aa0b-c2373730203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:57.963431 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3b73183f-17d4-4e48-aa0b-c2373730203f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:57.964895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3b73183f-17d4-4e48-aa0b-c2373730203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:57.973089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 939/1860] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:28:57.977527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044670c-2f08-4fcb-b989-9e43308d0e5a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:57.989235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044670c-2f08-4fcb-b989-9e43308d0e5a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:57.995955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:57.996195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:57.996578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:57.996900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:57.997740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:28:57.998052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:57.999675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.015875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 922/1861] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:28:58.020122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73183f-17d4-4e48-aa0b-c2373730203f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.030887 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73183f-17d4-4e48-aa0b-c2373730203f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.035755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.036651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.037106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.037679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.038384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.040419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.083152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 940/1862] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:58 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:58.084521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.097548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981980ed-7489-49fb-8bd2-0171883f90b6 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.170656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.171812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.172227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.172623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.173442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.176239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.215492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 923/1863] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:58 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:58.216219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.230334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9bf20-8a40-4541-9f5d-d852436527b8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.235141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.235760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.236032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.236295 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.236940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.238549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.254849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 941/1864] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:58.258943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.272200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29660d7f-af04-4631-b3c6-273fb449e6b9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.280473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa2fb7-c408-44bb-9ff7-efde0167fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.281150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa2fb7-c408-44bb-9ff7-efde0167fd14 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.281472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa2fb7-c408-44bb-9ff7-efde0167fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.281843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa2fb7-c408-44bb-9ff7-efde0167fd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.282545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa2fb7-c408-44bb-9ff7-efde0167fd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.284187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa2fb7-c408-44bb-9ff7-efde0167fd14 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.304729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 924/1865] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:58.306761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.321334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a0a4-6bd0-497f-8702-55202ffbb1be admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.326736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.327574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.327917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.328266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] PATH_INFO: `/v3/projects/1958c440816c4161ac230701e184cebe/users/30f8ebd0647d4fd3ba5596c35950613e/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.347435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1958c440816c4161ac230701e184cebe, user_id=30f8ebd0647d4fd3ba5596c35950613e, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.350622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.365378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 942/1866] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:58 2022] PUT /identity/v3/projects/1958c440816c4161ac230701e184cebe/users/30f8ebd0647d4fd3ba5596c35950613e/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:58.376827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276c909-b8c1-4479-8a99-57a3f94caa4e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.377136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276c909-b8c1-4479-8a99-57a3f94caa4e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.377350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276c909-b8c1-4479-8a99-57a3f94caa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.409473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b276c909-b8c1-4479-8a99-57a3f94caa4e None None] MFA Rules not processed for user `30f8ebd0647d4fd3ba5596c35950613e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:58.410861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b276c909-b8c1-4479-8a99-57a3f94caa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:58.415021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:58.487844 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 925/1867] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:58.492756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.561291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62833e-698d-4c2b-b4a4-16cea2dbec99 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.567176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.567843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.568112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.568394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.569020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.570950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.592149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:58.602717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 943/1868] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:28:58 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:28:58.606647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276c909-b8c1-4479-8a99-57a3f94caa4e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.617879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276c909-b8c1-4479-8a99-57a3f94caa4e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.684297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.684917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.685197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.685469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.686103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.688053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.710226 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 926/1869] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:28:58 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:28:58.714401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.725025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308f93-90ca-4b4e-96f6-28dd9dfd09e5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.730271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.730932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.731217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.731486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.732128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.733862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.749667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 944/1870] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:58.751246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.764271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9c5f9-62f8-41ad-9f6a-d648cce6923c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.769566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.770244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.770504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.770847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] PATH_INFO: `/v3/projects/2695586e9d5c4e1393ed9d7c5c8078c0/users/7061952873e1429aaef7723b65ecc41e/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.794857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2695586e9d5c4e1393ed9d7c5c8078c0, user_id=7061952873e1429aaef7723b65ecc41e, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.797886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.813667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 927/1871] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:58 2022] PUT /identity/v3/projects/2695586e9d5c4e1393ed9d7c5c8078c0/users/7061952873e1429aaef7723b65ecc41e/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:58.818025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.828819 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6a53-737b-4571-9d43-935d433a511d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.893445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff957-ef05-4916-a048-ad24bd70e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.894074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff957-ef05-4916-a048-ad24bd70e0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.894349 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff957-ef05-4916-a048-ad24bd70e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.894623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff957-ef05-4916-a048-ad24bd70e0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.895292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff957-ef05-4916-a048-ad24bd70e0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.897137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff957-ef05-4916-a048-ad24bd70e0b1 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.912159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 945/1872] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:28:58.913513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:58.924689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927c5e-9748-4a5a-831d-e17e0e4ec98a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:58.929969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:58.930707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.931170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.931471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] PATH_INFO: `/v3/projects/2695586e9d5c4e1393ed9d7c5c8078c0/users/7061952873e1429aaef7723b65ecc41e/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.933646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2695586e9d5c4e1393ed9d7c5c8078c0, user_id=7061952873e1429aaef7723b65ecc41e, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:58.936360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:58.948031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 928/1873] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:28:58 2022] PUT /identity/v3/projects/2695586e9d5c4e1393ed9d7c5c8078c0/users/7061952873e1429aaef7723b65ecc41e/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:28:58.958883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8e77-41f9-4a92-a377-a02c2c86d915 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:58.959341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8e77-41f9-4a92-a377-a02c2c86d915 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:58.959697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8e77-41f9-4a92-a377-a02c2c86d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:58.993308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-933f8e77-41f9-4a92-a377-a02c2c86d915 None None] MFA Rules not processed for user `7061952873e1429aaef7723b65ecc41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:28:58.994016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-933f8e77-41f9-4a92-a377-a02c2c86d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:59.066970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 946/1874] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:28:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:28:59.078612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:59.080792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:28:59.152839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8328fa-d9de-4736-93b3-46cc8d282616 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:59.156707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b5d1a-1b00-479a-86e5-a2e94d53dd5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:59.157339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d1a-1b00-479a-86e5-a2e94d53dd5e service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:59.157617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d1a-1b00-479a-86e5-a2e94d53dd5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:59.157887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d1a-1b00-479a-86e5-a2e94d53dd5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:59.167153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5d1a-1b00-479a-86e5-a2e94d53dd5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:59.168929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5d1a-1b00-479a-86e5-a2e94d53dd5e service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:59.173820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:59.178931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 929/1875] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:28:59.267136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f8e77-41f9-4a92-a377-a02c2c86d915 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:28:59.277138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f8e77-41f9-4a92-a377-a02c2c86d915 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:28:59.281309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d77ac5-682b-46a5-bd64-fa1655f0b162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:28:59.281961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77ac5-682b-46a5-bd64-fa1655f0b162 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:28:59.282225 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77ac5-682b-46a5-bd64-fa1655f0b162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:28:59.282500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77ac5-682b-46a5-bd64-fa1655f0b162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:28:59.356548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d77ac5-682b-46a5-bd64-fa1655f0b162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:28:59.358075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d77ac5-682b-46a5-bd64-fa1655f0b162 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:28:59.369636 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 947/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:28:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:04.086693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fc361-e94b-4213-99fa-aef48019d473 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:04.087364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fc361-e94b-4213-99fa-aef48019d473 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:04.087688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fc361-e94b-4213-99fa-aef48019d473 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:04.089339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 930/1877] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 13:29:04.122278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f0af-659f-4196-a0e5-312dda3e0731 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:04.123371 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f0af-659f-4196-a0e5-312dda3e0731 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:04.123930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f0af-659f-4196-a0e5-312dda3e0731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:04.145916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:04.158186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-92b1f0af-659f-4196-a0e5-312dda3e0731 None None] MFA Rules not processed for user `a0085283bb7642b1a37fbd122831289d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:04.159710 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-92b1f0af-659f-4196-a0e5-312dda3e0731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:04.247525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 948/1878] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:29:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:04.275563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fc361-e94b-4213-99fa-aef48019d473 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:04.277709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-803fc361-e94b-4213-99fa-aef48019d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:04.302872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fc361-e94b-4213-99fa-aef48019d473 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:04.308609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d686f1-c656-4479-832d-857fe1104fe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:04.309454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d686f1-c656-4479-832d-857fe1104fe5 service placement] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:04.309939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d686f1-c656-4479-832d-857fe1104fe5 service placement] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:04.310568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d686f1-c656-4479-832d-857fe1104fe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:04.329544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d686f1-c656-4479-832d-857fe1104fe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:04.340359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d686f1-c656-4479-832d-857fe1104fe5 service placement] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:04.353852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 931/1879] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:04.355893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f0af-659f-4196-a0e5-312dda3e0731 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:04.437173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f0af-659f-4196-a0e5-312dda3e0731 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:04.442768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:04.443598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:04.443877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:04.444154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] PATH_INFO: `/v3/users/30f8ebd0647d4fd3ba5596c35950613e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:04.445327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f8ebd0647d4fd3ba5596c35950613e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:04.447438 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:04.514059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f8ebd0647d4fd3ba5596c35950613e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:04.535535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f8ebd0647d4fd3ba5596c35950613e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:04.536369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f8ebd0647d4fd3ba5596c35950613e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:04.537281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f8ebd0647d4fd3ba5596c35950613e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:04.553038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f8ebd0647d4fd3ba5596c35950613e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:04.590880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 949/1880] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:04 2022] DELETE /identity/v3/users/30f8ebd0647d4fd3ba5596c35950613e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:04.595442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:04.595726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:04.595996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:04.618619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:04.620276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:04.709575 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 932/1881] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:04.729342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:04.731070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:04.773129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:04.839670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672ea3-3dbb-497e-841b-cb79afedf5f2 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:04.845452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:04.846078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:04.846353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:04.846623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:04.857252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:04.858733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:04.872264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 950/1882] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:05.062899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:05.064859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:05.086578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11f9ae-afb7-4a1d-9da6-1023206e81b4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:05.095885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:05.096659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:05.097106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:05.097501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] PATH_INFO: `/v3/users/95f1911f4a3444e292bcd734d4d31d77` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:05.098949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f1911f4a3444e292bcd734d4d31d77)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:05.101356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:05.150926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f1911f4a3444e292bcd734d4d31d77'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.157990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f1911f4a3444e292bcd734d4d31d77'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.158672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f1911f4a3444e292bcd734d4d31d77'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.159295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f1911f4a3444e292bcd734d4d31d77'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.167705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f1911f4a3444e292bcd734d4d31d77'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.194838 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 933/1883] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:05 2022] DELETE /identity/v3/users/95f1911f4a3444e292bcd734d4d31d77 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:05.207247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:05.208831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:05.222281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe33a-4cb4-4b87-ad0f-19fd896f247c service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:05.283874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:05.284547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:05.284824 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:05.285095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] PATH_INFO: `/v3/projects/1958c440816c4161ac230701e184cebe` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:05.286254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1958c440816c4161ac230701e184cebe)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:05.288678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:05.338490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1958c440816c4161ac230701e184cebe', 'request_id': 'req-4cc39fd0-d313-4192-a26a-b28a3b736ef6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.346260 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1958c440816c4161ac230701e184cebe', 'request_id': 'req-4cc39fd0-d313-4192-a26a-b28a3b736ef6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.353617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1958c440816c4161ac230701e184cebe', 'request_id': 'req-4cc39fd0-d313-4192-a26a-b28a3b736ef6'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.365406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] The token cache is being invalidate because project 1958c440816c4161ac230701e184cebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:05.365695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.366354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.367901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 951/1884] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:05 2022] DELETE /identity/v3/projects/1958c440816c4161ac230701e184cebe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:05.371949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:05.373942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:05.384286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:05.386116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:05.388346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72037f1-3793-4f4d-87fd-ceb56bc53f48 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:05.453082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:05.458721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc39fd0-d313-4192-a26a-b28a3b736ef6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:05.462145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:05.462710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:05.463079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:05.463468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] PATH_INFO: `/v3/users/7061952873e1429aaef7723b65ecc41e` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:05.464691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7061952873e1429aaef7723b65ecc41e)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:05.464909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:05.465778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:05.466055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:05.466329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] PATH_INFO: `/v3/projects/0ce44f04da914fb0b0f341b6fe459237` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:05.466619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:05.467477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce44f04da914fb0b0f341b6fe459237)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:05.468284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:05.469391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:05.519712 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce44f04da914fb0b0f341b6fe459237', 'request_id': 'req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.529573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce44f04da914fb0b0f341b6fe459237', 'request_id': 'req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.531324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7061952873e1429aaef7723b65ecc41e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.537967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce44f04da914fb0b0f341b6fe459237', 'request_id': 'req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.540498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7061952873e1429aaef7723b65ecc41e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.541305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7061952873e1429aaef7723b65ecc41e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.541947 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7061952873e1429aaef7723b65ecc41e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.549250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] The token cache is being invalidate because project 0ce44f04da914fb0b0f341b6fe459237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:05.549771 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.550313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7061952873e1429aaef7723b65ecc41e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.550576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.552647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 952/1885] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:05 2022] DELETE /identity/v3/projects/0ce44f04da914fb0b0f341b6fe459237 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:05.556591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:05.557992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:05.568886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 934/1886] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:05 2022] DELETE /identity/v3/users/7061952873e1429aaef7723b65ecc41e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:05.627314 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ebe4-4f1b-4717-a2ab-4176c0ba2475 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:05.693125 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:05.693899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:05.694210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:05.694483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] PATH_INFO: `/v3/users/73a3fed96f54429fb9ace70b13789211` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:05.695683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a3fed96f54429fb9ace70b13789211)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:05.697671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:05.740545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:05.753252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a3fed96f54429fb9ace70b13789211'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.774054 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a3fed96f54429fb9ace70b13789211'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.774809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a3fed96f54429fb9ace70b13789211'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.775472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a3fed96f54429fb9ace70b13789211'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.784544 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a3fed96f54429fb9ace70b13789211'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:05.803705 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 953/1887] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:05 2022] DELETE /identity/v3/users/73a3fed96f54429fb9ace70b13789211 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:05.885369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:05.888027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:05.917180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59370877-9bd8-460f-8e48-9bbc251bdcec admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.019697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.020629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.021085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.027765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] PATH_INFO: `/v3/projects/2695586e9d5c4e1393ed9d7c5c8078c0` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.030129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2695586e9d5c4e1393ed9d7c5c8078c0)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.032792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.064639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.066320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:06.082868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816bc37-fcf7-49b9-8e29-875edc7ce608 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.091474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2695586e9d5c4e1393ed9d7c5c8078c0', 'request_id': 'req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.103045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2695586e9d5c4e1393ed9d7c5c8078c0', 'request_id': 'req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.110683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2695586e9d5c4e1393ed9d7c5c8078c0', 'request_id': 'req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.122904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] The token cache is being invalidate because project 2695586e9d5c4e1393ed9d7c5c8078c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:06.123326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.124000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cb33ce6e-d8e8-4267-88c2-fdf35e5d2cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.129707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 935/1888] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:05 2022] DELETE /identity/v3/projects/2695586e9d5c4e1393ed9d7c5c8078c0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:06.131312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577ea7-96d9-42bc-a254-22213c1f7849 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.131598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577ea7-96d9-42bc-a254-22213c1f7849 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.131867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577ea7-96d9-42bc-a254-22213c1f7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.164230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d2577ea7-96d9-42bc-a254-22213c1f7849 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:06.165457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d2577ea7-96d9-42bc-a254-22213c1f7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:06.171563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.172307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.172585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.172855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] PATH_INFO: `/v3/projects/b19c3dffc88744ba941a3b52a898ef39` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.186251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 936/1889] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:06.186473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19c3dffc88744ba941a3b52a898ef39)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.186473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.188310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce464-efec-4600-91bc-92029f61a838 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.188812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce464-efec-4600-91bc-92029f61a838 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.188928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce464-efec-4600-91bc-92029f61a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.199568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:06.216516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8a9ce464-efec-4600-91bc-92029f61a838 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:06.218734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8a9ce464-efec-4600-91bc-92029f61a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:06.235383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 937/1890] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:06.237935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce464-efec-4600-91bc-92029f61a838 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.239804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19c3dffc88744ba941a3b52a898ef39', 'request_id': 'req-bf9b11f1-e88c-4213-8e96-504965252b73'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.248250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19c3dffc88744ba941a3b52a898ef39', 'request_id': 'req-bf9b11f1-e88c-4213-8e96-504965252b73'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.256382 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce464-efec-4600-91bc-92029f61a838 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.260673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19c3dffc88744ba941a3b52a898ef39', 'request_id': 'req-bf9b11f1-e88c-4213-8e96-504965252b73'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.273154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] The token cache is being invalidate because project b19c3dffc88744ba941a3b52a898ef39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:06.273441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.274220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf9b11f1-e88c-4213-8e96-504965252b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:06.278370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 954/1891] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:06 2022] DELETE /identity/v3/projects/b19c3dffc88744ba941a3b52a898ef39 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:06.283004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282dbda-e57e-4fd6-af5e-941f2c71c639 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.283286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282dbda-e57e-4fd6-af5e-941f2c71c639 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.283643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282dbda-e57e-4fd6-af5e-941f2c71c639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.311469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7282dbda-e57e-4fd6-af5e-941f2c71c639 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:06.312942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7282dbda-e57e-4fd6-af5e-941f2c71c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:06.385373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.386462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.387035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.387600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.390646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:06.391118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.393181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.407017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:06.410653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 938/1892] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:06.414202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.417721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:06.442439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 955/1893] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:06.442676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b54ad8-eed1-484b-9d77-98dc8225e12c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.444231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1bf41-569e-4cd2-8d9c-1c2294e9b17e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.444521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1bf41-569e-4cd2-8d9c-1c2294e9b17e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.444817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1bf41-569e-4cd2-8d9c-1c2294e9b17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.447039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.447666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.447939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.448344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.451153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.461718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.483324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c8e1bf41-569e-4cd2-8d9c-1c2294e9b17e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:06.485275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c8e1bf41-569e-4cd2-8d9c-1c2294e9b17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:06.497106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 956/1894] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:06.501028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1bf41-569e-4cd2-8d9c-1c2294e9b17e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.506155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 939/1895] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:06.510930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.513828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1bf41-569e-4cd2-8d9c-1c2294e9b17e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.600818 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.601443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.601718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.601986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.602689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:06.603016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.603461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9584e3b-094f-4ab2-8736-2a977130e898 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.604910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.609506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.610416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.610994 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.611484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.612385 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.614580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.620302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 957/1896] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:06.624816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.640470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4941ef-14ea-4dea-bd96-a0dccf5da232 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.648431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 940/1897] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:29:06.648823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.648823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.648823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.648823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.649217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.649892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.650559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.660370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fe5f2-923a-4c46-a123-a5476230ce4a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.665209 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.665817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.666093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.666361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.667038 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.668986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.682606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 941/1898] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:29:06.682847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 958/1899] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:06.683886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.685064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.694916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d374b-6e35-44a4-8966-975ba7d06d1e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.742581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:06.749540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8f7a6-f0c1-4ce3-9748-5d22b7036dd1 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.754256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.754970 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.755340 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.755770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.756143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.756407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.756756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.757035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.757299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.757938 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.758342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.759579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.771275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 942/1900] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:06.775635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.780300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 959/1901] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:06.784291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.785997 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ef380-353c-43d0-b157-da1c99a8f504 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.791631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6c140-803d-4154-8351-8fef6e07a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.792326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6c140-803d-4154-8351-8fef6e07a820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.792602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6c140-803d-4154-8351-8fef6e07a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.792865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6c140-803d-4154-8351-8fef6e07a820 admin admin] PATH_INFO: `/v3/projects/b85255bf972c4f6bad51e0e6a42754e1/users/74ae9026af884b14bdac3d62075af5e9/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.794512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2e15a-ad05-45f8-86d1-185090f72d70 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.799194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.799802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.800109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.800381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.801016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.803090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.810155 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6c140-803d-4154-8351-8fef6e07a820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85255bf972c4f6bad51e0e6a42754e1, user_id=74ae9026af884b14bdac3d62075af5e9, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.812847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6c140-803d-4154-8351-8fef6e07a820 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.813947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 960/1902] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:06.818016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.828965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6029f0-c537-4bd4-86de-5e9160ae368a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.837226 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 943/1903] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:06 2022] PUT /identity/v3/projects/b85255bf972c4f6bad51e0e6a42754e1/users/74ae9026af884b14bdac3d62075af5e9/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:06.847751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b288db-d8fc-4c52-bd68-704216bece8e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.848040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b288db-d8fc-4c52-bd68-704216bece8e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.848312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b288db-d8fc-4c52-bd68-704216bece8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.854680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:06.878187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e8b288db-d8fc-4c52-bd68-704216bece8e None None] MFA Rules not processed for user `74ae9026af884b14bdac3d62075af5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:06.879436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e8b288db-d8fc-4c52-bd68-704216bece8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:06.888412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.889053 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.889331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.889602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.890242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.891912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.905928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 961/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:29:06.906803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.918308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45dc4f-49da-4ca8-8626-fc4b1c62f643 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:06.924561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2c11c-57d6-46de-9161-63a10658f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:06.925253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c11c-57d6-46de-9161-63a10658f6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.925552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c11c-57d6-46de-9161-63a10658f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.925803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c11c-57d6-46de-9161-63a10658f6a0 admin admin] PATH_INFO: `/v3/projects/12dd6fbab93148b5a2f3cf8ac5fb4445/users/32c7886aee5a4b4bbddd69fc59c97440/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.946619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2c11c-57d6-46de-9161-63a10658f6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dd6fbab93148b5a2f3cf8ac5fb4445, user_id=32c7886aee5a4b4bbddd69fc59c97440, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:06.950880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2c11c-57d6-46de-9161-63a10658f6a0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:06.962856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 944/1905] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:06.967301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 962/1906] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:06 2022] PUT /identity/v3/projects/12dd6fbab93148b5a2f3cf8ac5fb4445/users/32c7886aee5a4b4bbddd69fc59c97440/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:06.968119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b288db-d8fc-4c52-bd68-704216bece8e None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:06.977982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:06.978360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:06.978691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:06.980509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b288db-d8fc-4c52-bd68-704216bece8e None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.015478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] MFA Rules not processed for user `32c7886aee5a4b4bbddd69fc59c97440`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:07.016766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:07.053312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.054558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.054863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.055136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.055901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.058210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.100267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 945/1907] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:07.104709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.124873 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 963/1908] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:07.138016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.151913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:07.159719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:07.189886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243b0c-7fdd-495e-ab26-cf2b62c34eaa admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.194567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.195240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.195517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.195796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.196426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.198353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.211096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23005f2-7e0e-4553-87f0-500c6f691439 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.227511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 946/1909] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:07 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:07.231541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.242337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67934bd-81b7-438e-b9f1-50e0468cd807 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.247645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.248247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.248524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.248790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.249484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.251124 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.255609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:07.263144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 947/1910] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:07.263898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.264509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.264766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.265034 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.267477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.277320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a909f2-64d6-4ec3-8492-53025eea4cc3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.282103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.282785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.283099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.283374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] PATH_INFO: `/v3/projects/4f05b001168a485f952730f78747b727/users/ffc376b9a7304242834ffc1a0e788277/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.301085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f05b001168a485f952730f78747b727, user_id=ffc376b9a7304242834ffc1a0e788277, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.303893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.319012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 948/1911] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:07 2022] PUT /identity/v3/projects/4f05b001168a485f952730f78747b727/users/ffc376b9a7304242834ffc1a0e788277/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:07.323129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.330106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.331751 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.342505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 964/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:29:07.365444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.381966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836470-f953-4cd8-b131-79527251ee68 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.421784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40f718-ff83-47e3-8aca-f72dd0d9b131 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.427907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.428624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.428961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.429339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.430067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.431793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.442755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 949/1913] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:07.447724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.454732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.455504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.455701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.455948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] PATH_INFO: `/v3/users/32c7886aee5a4b4bbddd69fc59c97440` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.457112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c7886aee5a4b4bbddd69fc59c97440)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.459905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16992d21-4491-4c95-b5e9-2ecea6b473a8 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.460050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.462778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64c0f4-b7b4-4a2f-95d5-8bb017a53ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.463474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64c0f4-b7b4-4a2f-95d5-8bb017a53ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.463753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64c0f4-b7b4-4a2f-95d5-8bb017a53ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.464025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64c0f4-b7b4-4a2f-95d5-8bb017a53ff9 admin admin] PATH_INFO: `/v3/projects/4f05b001168a485f952730f78747b727/users/ffc376b9a7304242834ffc1a0e788277/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.466636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64c0f4-b7b4-4a2f-95d5-8bb017a53ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f05b001168a485f952730f78747b727, user_id=ffc376b9a7304242834ffc1a0e788277, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.469308 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64c0f4-b7b4-4a2f-95d5-8bb017a53ff9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.482921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 950/1914] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:07 2022] PUT /identity/v3/projects/4f05b001168a485f952730f78747b727/users/ffc376b9a7304242834ffc1a0e788277/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:07.501059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.501595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.502080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.524546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c7886aee5a4b4bbddd69fc59c97440'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:07.534484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c7886aee5a4b4bbddd69fc59c97440'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:07.535394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c7886aee5a4b4bbddd69fc59c97440'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:07.535900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c7886aee5a4b4bbddd69fc59c97440'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:07.537971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] MFA Rules not processed for user `ffc376b9a7304242834ffc1a0e788277`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:07.539309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:07.548401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-05489490-13d2-46a1-9975-0e6bcbd13bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c7886aee5a4b4bbddd69fc59c97440'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:07.572436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 965/1915] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:07 2022] DELETE /identity/v3/users/32c7886aee5a4b4bbddd69fc59c97440 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:07.587073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.587073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.587073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.598569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:07.599841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:07.606448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:07.612384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:07.619343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 951/1916] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:07.630717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.632692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:07.674778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 966/1917] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:07.684844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:07.686352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:07.694919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03177f-891e-4a31-9e1c-b15f83e78402 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.741549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7a5f-69a0-4c39-9585-b11a6368bd04 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:07.745203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.745837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.746108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.746212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2e3d-f47b-43a7-b588-95f6f23446b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:07.746392 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.746905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2e3d-f47b-43a7-b588-95f6f23446b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:07.747198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2e3d-f47b-43a7-b588-95f6f23446b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:07.747465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2e3d-f47b-43a7-b588-95f6f23446b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:07.756877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.758566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.768581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 967/1918] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:29:07.813990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e2e3d-f47b-43a7-b588-95f6f23446b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:07.815507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e2e3d-f47b-43a7-b588-95f6f23446b7 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:07.837421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 952/1919] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:29:08.078144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.079607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.108573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c7d11-a21e-4edb-8c3e-8e02788e7c40 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.132392 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.133062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.133394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.133660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] PATH_INFO: `/v3/projects/12dd6fbab93148b5a2f3cf8ac5fb4445` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.134865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12dd6fbab93148b5a2f3cf8ac5fb4445)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.136795 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.194140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12dd6fbab93148b5a2f3cf8ac5fb4445', 'request_id': 'req-e59d9439-71d8-4584-97ac-25a06f7b8574'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.207163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12dd6fbab93148b5a2f3cf8ac5fb4445', 'request_id': 'req-e59d9439-71d8-4584-97ac-25a06f7b8574'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.214730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12dd6fbab93148b5a2f3cf8ac5fb4445', 'request_id': 'req-e59d9439-71d8-4584-97ac-25a06f7b8574'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.230297 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] The token cache is being invalidate because project 12dd6fbab93148b5a2f3cf8ac5fb4445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:08.230592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.231288 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e59d9439-71d8-4584-97ac-25a06f7b8574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.234144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 968/1920] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:08 2022] DELETE /identity/v3/projects/12dd6fbab93148b5a2f3cf8ac5fb4445 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:08.240735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2540-3f51-40fc-bd0a-76979f5b6d2b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.241892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2540-3f51-40fc-bd0a-76979f5b6d2b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.242369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2540-3f51-40fc-bd0a-76979f5b6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.271966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b84a2540-3f51-40fc-bd0a-76979f5b6d2b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:08.273351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b84a2540-3f51-40fc-bd0a-76979f5b6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.360424 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 953/1921] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:08.370463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4abc-bea2-47f3-a81e-e253c30b1b27 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.371025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4abc-bea2-47f3-a81e-e253c30b1b27 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.371148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4abc-bea2-47f3-a81e-e253c30b1b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.394041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-709c4abc-bea2-47f3-a81e-e253c30b1b27 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:08.395272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-709c4abc-bea2-47f3-a81e-e253c30b1b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.408688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 969/1922] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:08.413738 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a2540-3f51-40fc-bd0a-76979f5b6d2b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.420208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:08.426283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a2540-3f51-40fc-bd0a-76979f5b6d2b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.431915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.432669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.433148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.433492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.434199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:08.434503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.447331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.464753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 954/1923] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:08.465935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4abc-bea2-47f3-a81e-e253c30b1b27 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.480794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4abc-bea2-47f3-a81e-e253c30b1b27 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.486796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.487435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.487713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.488231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.488779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.490962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.494140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.495940 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.514338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d511f-21e7-49d7-894a-6865a871eeb2 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.519562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.520355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.520742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.521101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] PATH_INFO: `/v3/users/74ae9026af884b14bdac3d62075af5e9` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.522411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ae9026af884b14bdac3d62075af5e9)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.524428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.526858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 970/1924] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:08 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:29:08.531086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.562956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:08.585503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ae9026af884b14bdac3d62075af5e9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.594094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ae9026af884b14bdac3d62075af5e9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.594094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ae9026af884b14bdac3d62075af5e9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.595229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ae9026af884b14bdac3d62075af5e9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.605043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-31591872-ced9-4c05-9c56-ff09d430492c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ae9026af884b14bdac3d62075af5e9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:08.612102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0799f-78b2-4c31-a215-39db573a24af admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.617944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.618668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.619036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.619368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.620079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.622427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.636499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 955/1925] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:08 2022] DELETE /identity/v3/users/74ae9026af884b14bdac3d62075af5e9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:08.641694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.642756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.643263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.662212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 971/1926] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:08 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:29:08.666720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.668865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.671617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:08.672757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.682857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde9d2e-e8f8-4c8a-a43d-872fb9ee1ed6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.751402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.751907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.752179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.752450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.753227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.755251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.759640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 956/1927] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:08.768368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 972/1928] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:08.769401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.771660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.772629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.784694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acbb4a-2048-4e26-8b98-efcbd54f27da admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.793950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.795025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.795680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.796198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.797143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.799567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.824060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 973/1929] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:29:08.828304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:08.840113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c032f7a-cfbd-415c-843b-0b853ae6eada admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.847573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3cefd-4d9d-492b-922d-ea1e4995158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.848807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3cefd-4d9d-492b-922d-ea1e4995158f admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.849525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3cefd-4d9d-492b-922d-ea1e4995158f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.850136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3cefd-4d9d-492b-922d-ea1e4995158f admin admin] PATH_INFO: `/v3/projects/376ccd64ec974a9b9dff503aac5c409a/users/980af99faa054b1da95dcbb27a26a8ec/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.875677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3cefd-4d9d-492b-922d-ea1e4995158f admin admin] RBAC: Authorizing `identity:create_grant(project_id=376ccd64ec974a9b9dff503aac5c409a, user_id=980af99faa054b1da95dcbb27a26a8ec, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:08.878963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3cefd-4d9d-492b-922d-ea1e4995158f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:08.896241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcab15-639b-4337-bf70-b355a62c30eb None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:08.903923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 974/1930] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:08 2022] PUT /identity/v3/projects/376ccd64ec974a9b9dff503aac5c409a/users/980af99faa054b1da95dcbb27a26a8ec/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:08.913650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:08.914164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.914443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.914713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:08.947532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] MFA Rules not processed for user `980af99faa054b1da95dcbb27a26a8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:08.949229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:08.959508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:08.960134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:08.960413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:08.960683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:09.023100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:09.039026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 975/1931] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:09.049659 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:09.051207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:09.064620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:09.067836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:09.069895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 957/1932] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:09.135642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15ee6-a681-4f0b-abfb-ef6eb719b091 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:09.141891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:09.142973 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:09.143352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:09.143703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:09.154245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:09.155919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:09.165958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 976/1933] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:29:09.416262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:09.418355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:09.432896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0dea1-8d38-4a2d-ae5c-1ba810014810 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:09.438839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:09.439515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:09.439787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:09.440040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] PATH_INFO: `/v3/projects/b85255bf972c4f6bad51e0e6a42754e1` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:09.441296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85255bf972c4f6bad51e0e6a42754e1)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:09.443425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:09.500207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85255bf972c4f6bad51e0e6a42754e1', 'request_id': 'req-5d2265c5-fb80-4e63-9a9f-4b50f7396220'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.515466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85255bf972c4f6bad51e0e6a42754e1', 'request_id': 'req-5d2265c5-fb80-4e63-9a9f-4b50f7396220'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.523922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85255bf972c4f6bad51e0e6a42754e1', 'request_id': 'req-5d2265c5-fb80-4e63-9a9f-4b50f7396220'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.534617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] The token cache is being invalidate because project b85255bf972c4f6bad51e0e6a42754e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:09.534926 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.535578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.537333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 958/1934] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:09 2022] DELETE /identity/v3/projects/b85255bf972c4f6bad51e0e6a42754e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:09.541601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:09.554707 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67955d47-b9d7-4710-bc2c-4d63ac0826e1 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:09.621912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:09.622473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:09.622781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:09.623101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] PATH_INFO: `/v3/users/ffc376b9a7304242834ffc1a0e788277` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:09.624264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc376b9a7304242834ffc1a0e788277)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:09.626188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:09.673451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc376b9a7304242834ffc1a0e788277'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.680506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc376b9a7304242834ffc1a0e788277'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.681188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc376b9a7304242834ffc1a0e788277'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.681819 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc376b9a7304242834ffc1a0e788277'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.691391 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-542b8a56-be88-49d2-858e-3f8a2f67a6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc376b9a7304242834ffc1a0e788277'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:09.708505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 977/1935] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:09 2022] DELETE /identity/v3/users/ffc376b9a7304242834ffc1a0e788277 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:09.987834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:09.989664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:10.003876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2265c5-fb80-4e63-9a9f-4b50f7396220 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.060033 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:10.079893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.080582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.080859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.081130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] PATH_INFO: `/v3/projects/4f05b001168a485f952730f78747b727` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.082753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f05b001168a485f952730f78747b727)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.085142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.140696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f05b001168a485f952730f78747b727', 'request_id': 'req-738c13d1-0065-4d85-a336-5654a9180ff1'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:10.149584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f05b001168a485f952730f78747b727', 'request_id': 'req-738c13d1-0065-4d85-a336-5654a9180ff1'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:10.156790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f05b001168a485f952730f78747b727', 'request_id': 'req-738c13d1-0065-4d85-a336-5654a9180ff1'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:10.167448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] The token cache is being invalidate because project 4f05b001168a485f952730f78747b727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:10.167768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:10.168774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-738c13d1-0065-4d85-a336-5654a9180ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:10.170297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 959/1936] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:09 2022] DELETE /identity/v3/projects/4f05b001168a485f952730f78747b727 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:10.175289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c5e7-24b3-41ae-995f-871f129faadc None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.175580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c5e7-24b3-41ae-995f-871f129faadc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.175857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c5e7-24b3-41ae-995f-871f129faadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.195436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2558c5e7-24b3-41ae-995f-871f129faadc None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:10.196662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2558c5e7-24b3-41ae-995f-871f129faadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:10.209248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:10.261219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 978/1937] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:10.270326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dbb5-b571-464e-a1fd-1fc3437f78f4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.270715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dbb5-b571-464e-a1fd-1fc3437f78f4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.270941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dbb5-b571-464e-a1fd-1fc3437f78f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.291545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5a91dbb5-b571-464e-a1fd-1fc3437f78f4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:10.292769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5a91dbb5-b571-464e-a1fd-1fc3437f78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:10.302202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 960/1938] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:10.306513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558c5e7-24b3-41ae-995f-871f129faadc None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.316132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558c5e7-24b3-41ae-995f-871f129faadc None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.321255 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.321870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.322129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.322408 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.323083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:10.323380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.324991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.336853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 979/1939] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:10.341925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91dbb5-b571-464e-a1fd-1fc3437f78f4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.353019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91dbb5-b571-464e-a1fd-1fc3437f78f4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.359221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.359831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.360104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.360370 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.361014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.363409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.399354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 961/1940] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:10 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:29:10.400601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.411833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8d8a-921c-49d5-9439-b433946c189b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.476081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.477179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.477324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.477575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.478200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.480139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.507070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 980/1941] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:10 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:10.508225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.519247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174d19-3b38-4b68-9380-964646e34602 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.526387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.527037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.527310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.527600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.528217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.529810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.547586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 962/1942] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:10.548713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.560139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1f4f-b281-4b08-b7d9-17f23125676f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.566576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3bed5-56ba-4d17-8207-838ac0d1265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.567401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3bed5-56ba-4d17-8207-838ac0d1265d admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.567782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3bed5-56ba-4d17-8207-838ac0d1265d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.568279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3bed5-56ba-4d17-8207-838ac0d1265d admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.568917 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3bed5-56ba-4d17-8207-838ac0d1265d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.570527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3bed5-56ba-4d17-8207-838ac0d1265d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.586848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 981/1943] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:29:10.590496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.601020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b33d5-4efa-4c0a-afde-89ee55c8bcf0 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.605736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.606400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.606678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.606992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] PATH_INFO: `/v3/projects/1853529361664c9684335efe00057af2/users/2d63435a81be4f26908d0f08707d1fae/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.623065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1853529361664c9684335efe00057af2, user_id=2d63435a81be4f26908d0f08707d1fae, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.625711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.640303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 963/1944] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:10 2022] PUT /identity/v3/projects/1853529361664c9684335efe00057af2/users/2d63435a81be4f26908d0f08707d1fae/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:10.651567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c655c-7c79-4cf5-be80-aef453e8b791 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.651794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c655c-7c79-4cf5-be80-aef453e8b791 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.652065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c655c-7c79-4cf5-be80-aef453e8b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.680627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-4f8c655c-7c79-4cf5-be80-aef453e8b791 None None] MFA Rules not processed for user `2d63435a81be4f26908d0f08707d1fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:10.681847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4f8c655c-7c79-4cf5-be80-aef453e8b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:10.749334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 982/1945] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:10.754483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.823703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4860-6fef-4515-968a-dcdb4a39a8ed admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.828466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.829106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.829381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.829648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.830277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.832265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.863558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 964/1946] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:10 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:10.867809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c655c-7c79-4cf5-be80-aef453e8b791 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.878998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c655c-7c79-4cf5-be80-aef453e8b791 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.888395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:10.937311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.937884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.938164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.938417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.939136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.941114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:10.963990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 983/1947] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:10 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:10.968215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:10.973986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:10.980962 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c93ccf-8b2a-4a9c-b2e1-e3a87090df4b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:10.987054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:10.987682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:10.987956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:10.988225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:10.988888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:10.990717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.001393 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 965/1948] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:11.005658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.015880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653f17-fc44-42bb-b09a-303464d42cd4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.021041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235df8e6-6377-45d1-bd63-5ba62ab96911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.021639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235df8e6-6377-45d1-bd63-5ba62ab96911 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.021902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235df8e6-6377-45d1-bd63-5ba62ab96911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.022173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235df8e6-6377-45d1-bd63-5ba62ab96911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.022830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235df8e6-6377-45d1-bd63-5ba62ab96911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.024438 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235df8e6-6377-45d1-bd63-5ba62ab96911 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.034412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 984/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:11.038612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.049158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62cdd7-9cc6-4e39-a0b6-07faa30fdbd1 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.054145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.054806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.055113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.055384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] PATH_INFO: `/v3/projects/1d0f937a94df4aa18f8bdcc66b99163d/users/d023002b230f48f2b46a433e6769a010/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.070210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0f937a94df4aa18f8bdcc66b99163d, user_id=d023002b230f48f2b46a433e6769a010, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.072891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.088417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 966/1950] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:11 2022] PUT /identity/v3/projects/1d0f937a94df4aa18f8bdcc66b99163d/users/d023002b230f48f2b46a433e6769a010/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:11.100927 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b785f-2617-42aa-9550-bf5844e6938c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.101318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b785f-2617-42aa-9550-bf5844e6938c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.101737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b785f-2617-42aa-9550-bf5844e6938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.135950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-963b785f-2617-42aa-9550-bf5844e6938c None None] MFA Rules not processed for user `d023002b230f48f2b46a433e6769a010`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:11.137191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-963b785f-2617-42aa-9550-bf5844e6938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:11.203097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 985/1951] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:11.208022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.271833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241b792-0919-446e-bacd-9192fb339ec6 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.276770 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.277401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.277682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.277957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.278601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.280584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.309350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 967/1952] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:11 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:11.313886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b785f-2617-42aa-9550-bf5844e6938c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.325533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b785f-2617-42aa-9550-bf5844e6938c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.393750 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.394368 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.394645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.394919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.395588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.397736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.427510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 986/1953] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:11 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:11.431907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.443677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d510-6400-4f18-a5a0-c27295afbaf2 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.449390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.450011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.450285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.450546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.451244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.452875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.464748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 968/1954] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:11.469155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.480404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980a6c9-93f9-4c94-85df-f419dcb5d6ad admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.485443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.486102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.486378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.486645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] PATH_INFO: `/v3/projects/bc4ab5aac2e04957b157f61a06140b1c/users/44627d628ca846bdb11edd3d7c00f930/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.495910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:11.503966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4ab5aac2e04957b157f61a06140b1c, user_id=44627d628ca846bdb11edd3d7c00f930, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.507348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.522482 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 987/1955] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:11 2022] PUT /identity/v3/projects/bc4ab5aac2e04957b157f61a06140b1c/users/44627d628ca846bdb11edd3d7c00f930/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:11.526501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.536979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5858e35-0779-477d-a52c-cbfb63bf6d32 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.601729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a02e0-085a-4b8d-98cb-7dd86f8baa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.602408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a02e0-085a-4b8d-98cb-7dd86f8baa12 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.602671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a02e0-085a-4b8d-98cb-7dd86f8baa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.602955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a02e0-085a-4b8d-98cb-7dd86f8baa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.603622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a02e0-085a-4b8d-98cb-7dd86f8baa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.605554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a02e0-085a-4b8d-98cb-7dd86f8baa12 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.622454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 969/1956] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:11.623267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.635306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239c9fe-89f7-4a2c-ba00-562564af1ee0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.640173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.640845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.641126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.641397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] PATH_INFO: `/v3/projects/bc4ab5aac2e04957b157f61a06140b1c/users/44627d628ca846bdb11edd3d7c00f930/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.643381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4ab5aac2e04957b157f61a06140b1c, user_id=44627d628ca846bdb11edd3d7c00f930, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.646975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.660068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 988/1957] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:11 2022] PUT /identity/v3/projects/bc4ab5aac2e04957b157f61a06140b1c/users/44627d628ca846bdb11edd3d7c00f930/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:11.670928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4d7b-843a-45f0-a12d-c10c46af7ede None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.671329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4d7b-843a-45f0-a12d-c10c46af7ede None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.671635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4d7b-843a-45f0-a12d-c10c46af7ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.702690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-870a4d7b-843a-45f0-a12d-c10c46af7ede None None] MFA Rules not processed for user `44627d628ca846bdb11edd3d7c00f930`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:11.703950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-870a4d7b-843a-45f0-a12d-c10c46af7ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:11.732189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:11.777593 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 970/1958] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:11.789938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:11.791933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:11.857194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93437279-56a2-4c72-b8ec-9450909f132c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:11.863781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:11.864948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:11.865233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:11.865502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:11.924083 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:11.925542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:11.935328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 989/1959] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:12.914215 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:12.914700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:12.914784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:12.935443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:12.936633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:13.001908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 971/1960] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:29:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:13.045331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:13.046995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:13.128147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3297-542c-4573-a992-2ef8331d38dc service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:13.133688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:13.134303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:13.134575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:13.134862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:13.143854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:13.145437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:13.154199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 990/1961] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:29:13.516622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:13.518126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:13.532346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80f7f2-2bb3-4fe8-b6c5-4dd18f752bda None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:13.537833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:13.538641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:13.538775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:13.539089 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:13.680528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:13.681974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:13.731428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 972/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:14.586245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:14.597324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5e763-7454-4495-8e60-998ec50308d4 service swift] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:14.603402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08252dc4-f03f-40c7-b111-dd5c01aa00cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:14.604194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08252dc4-f03f-40c7-b111-dd5c01aa00cf service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:14.604617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08252dc4-f03f-40c7-b111-dd5c01aa00cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:14.604897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08252dc4-f03f-40c7-b111-dd5c01aa00cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:14.615993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08252dc4-f03f-40c7-b111-dd5c01aa00cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:14.617756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08252dc4-f03f-40c7-b111-dd5c01aa00cf service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:14.629135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 991/1963] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:18.396153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:18.398568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:18.542288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e4d1e-b1d6-45b5-88a8-868d79e2173a service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:18.554754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:18.557332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:18.558396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:18.559039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] PATH_INFO: `/v3/users/980af99faa054b1da95dcbb27a26a8ec` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:18.561457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=980af99faa054b1da95dcbb27a26a8ec)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:18.565133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:18.585206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:18.660472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980af99faa054b1da95dcbb27a26a8ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:18.676191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980af99faa054b1da95dcbb27a26a8ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:18.677386 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980af99faa054b1da95dcbb27a26a8ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:18.678592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980af99faa054b1da95dcbb27a26a8ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:18.688840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980af99faa054b1da95dcbb27a26a8ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:18.717403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 973/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:18 2022] DELETE /identity/v3/users/980af99faa054b1da95dcbb27a26a8ec => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:18.721910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:18.722520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:18.722520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:18.734179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:18.763518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:18.768325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:18.903583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 992/1965] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:18.914401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:18.916148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:18.992858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ada83e-4862-4333-89d5-63984f4435e1 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:19.000647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef60f-f89c-4d93-a580-756a0d7aee9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:19.001342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef60f-f89c-4d93-a580-756a0d7aee9c service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:19.001657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef60f-f89c-4d93-a580-756a0d7aee9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:19.006030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef60f-f89c-4d93-a580-756a0d7aee9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:19.025101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef60f-f89c-4d93-a580-756a0d7aee9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:19.028598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef60f-f89c-4d93-a580-756a0d7aee9c service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:19.050413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 974/1966] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:19.130756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:19.132572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:19.158590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf717dc-f144-4831-bd46-1bdee232ae57 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:19.190342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:19.191762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:19.192109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:19.192586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] PATH_INFO: `/v3/users/2d63435a81be4f26908d0f08707d1fae` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:19.195739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d63435a81be4f26908d0f08707d1fae)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:19.200461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:19.401842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d63435a81be4f26908d0f08707d1fae'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:19.429086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d63435a81be4f26908d0f08707d1fae'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:19.431769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d63435a81be4f26908d0f08707d1fae'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:19.433271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d63435a81be4f26908d0f08707d1fae'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:19.447471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d63435a81be4f26908d0f08707d1fae'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:19.482880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 993/1967] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:19 2022] DELETE /identity/v3/users/2d63435a81be4f26908d0f08707d1fae => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:19.487292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:19.488983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:19.489269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:19.541381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:19.543003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:19.667124 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 975/1968] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:19.683554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:19.686805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:19.800663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567c6c7-a68d-4001-a734-003b9da01e5c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:19.805644 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1f7c7-d314-45d9-8282-3778c8783b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:19.807432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1f7c7-d314-45d9-8282-3778c8783b53 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:19.807879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1f7c7-d314-45d9-8282-3778c8783b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:19.808308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1f7c7-d314-45d9-8282-3778c8783b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:19.822581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1f7c7-d314-45d9-8282-3778c8783b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:19.824722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1f7c7-d314-45d9-8282-3778c8783b53 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:19.857220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 994/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:19.862697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:19.864170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:19.888781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dace9-184c-44a2-bf7e-de0c009cd4fc None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:19.897923 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:19.898807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:19.899957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:19.900502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] PATH_INFO: `/v3/projects/376ccd64ec974a9b9dff503aac5c409a` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:19.903406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376ccd64ec974a9b9dff503aac5c409a)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:19.907763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:19.955625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:19.997005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376ccd64ec974a9b9dff503aac5c409a', 'request_id': 'req-3e293264-0998-4acd-95c2-df3d8763e185'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.009362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376ccd64ec974a9b9dff503aac5c409a', 'request_id': 'req-3e293264-0998-4acd-95c2-df3d8763e185'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.026205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376ccd64ec974a9b9dff503aac5c409a', 'request_id': 'req-3e293264-0998-4acd-95c2-df3d8763e185'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.051141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] The token cache is being invalidate because project 376ccd64ec974a9b9dff503aac5c409a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:20.051818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.052804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3e293264-0998-4acd-95c2-df3d8763e185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.057724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 976/1970] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:19 2022] DELETE /identity/v3/projects/376ccd64ec974a9b9dff503aac5c409a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:20.064033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.065977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.067219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.121804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:20.123075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:20.141106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:20.246879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 995/1971] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:20.248283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129ebdf-94ff-4738-93af-94709767b496 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.248661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129ebdf-94ff-4738-93af-94709767b496 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.249201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129ebdf-94ff-4738-93af-94709767b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.289017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:20.290501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:20.305950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6129ebdf-94ff-4738-93af-94709767b496 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:20.308759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6129ebdf-94ff-4738-93af-94709767b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:20.323912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02d49d-8445-40b5-8ab0-d9fc9a84fc98 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:20.336103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:20.336791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.337073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.337345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] PATH_INFO: `/v3/projects/1853529361664c9684335efe00057af2` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.345206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1853529361664c9684335efe00057af2)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:20.347235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:20.349016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 977/1972] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:20.350035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129ebdf-94ff-4738-93af-94709767b496 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:20.377848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129ebdf-94ff-4738-93af-94709767b496 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:20.389737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:20.390521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.391183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.392164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.394762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:20.395854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:20.398534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:20.427896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 978/1973] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:20.439604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:20.459939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859d99-7b76-49ae-b352-0b4ae91ea277 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:20.485881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1853529361664c9684335efe00057af2', 'request_id': 'req-91824380-a5b5-4206-8acc-5af6448ecc87'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.499607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1853529361664c9684335efe00057af2', 'request_id': 'req-91824380-a5b5-4206-8acc-5af6448ecc87'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.507930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1853529361664c9684335efe00057af2', 'request_id': 'req-91824380-a5b5-4206-8acc-5af6448ecc87'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.522262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] The token cache is being invalidate because project 1853529361664c9684335efe00057af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:20.522262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.522766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.527706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 996/1974] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:20 2022] DELETE /identity/v3/projects/1853529361664c9684335efe00057af2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:20.533797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:20.535502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:20.601546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:20.602186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.602466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.602734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.603402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:20.607300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:20.682747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 979/1975] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:20 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:20.687671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:20.689696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:20.723152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824380-a5b5-4206-8acc-5af6448ecc87 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:20.824694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e016c-a7c7-4485-83da-29593783ff8c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:20.830105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:20.830694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.831199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.831568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.834416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:20.843851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:20.844057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:20.868189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:20.868503 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.868878 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.869246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] PATH_INFO: `/v3/users/d023002b230f48f2b46a433e6769a010` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.871880 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d023002b230f48f2b46a433e6769a010)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:20.874797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:20.905051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 980/1976] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:20 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:29:20.908795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:20.936409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e0641-7e83-4ff1-8128-c3cd8f7762ca admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:20.947159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:20.948040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:20.948411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:20.948845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:20.950051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:20.951995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:20.954102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:20.972736 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 981/1977] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:29:20.992560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd023002b230f48f2b46a433e6769a010'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:20.995883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:21.001826 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd023002b230f48f2b46a433e6769a010'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:21.002651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd023002b230f48f2b46a433e6769a010'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:21.003399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd023002b230f48f2b46a433e6769a010'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:21.015473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3a8a92aa-2055-45ee-ade7-22189e237224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd023002b230f48f2b46a433e6769a010'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:21.022204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2224d-ad53-411b-a109-4c2e6a2829c1 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:21.035512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:21.036522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:21.036951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:21.037616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:21.038406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:21.040190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:21.064915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 982/1978] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:21.068163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:21.073106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:21.077244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 997/1979] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:20 2022] DELETE /identity/v3/users/d023002b230f48f2b46a433e6769a010 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:21.097317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1f7f4-d684-4a9d-a540-3bccd684710f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:21.219533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:21.220387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:21.220737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:21.221109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] PATH_INFO: `/v3/projects/60d9161d469c439aa33ca1fa56cb9d8b/users/512be55cb8bf4ac39b93542b8d8b7ccf/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:21.265546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d9161d469c439aa33ca1fa56cb9d8b, user_id=512be55cb8bf4ac39b93542b8d8b7ccf, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:21.269808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:21.321953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 983/1980] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:21 2022] PUT /identity/v3/projects/60d9161d469c439aa33ca1fa56cb9d8b/users/512be55cb8bf4ac39b93542b8d8b7ccf/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:21.328092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:21.328377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:21.328651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:21.435318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] MFA Rules not processed for user `512be55cb8bf4ac39b93542b8d8b7ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:21.436574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:21.559935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 998/1981] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:21.573973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:21.577012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:21.632186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:21.644292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:21.871851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592bfcc-a681-48a7-a3d3-2f8d0f7db4be admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:21.881858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:21.882496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:21.882764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:21.883053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:21.914506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:21.916053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:21.939296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06919dc-99ba-43e7-8a9f-ddc14474b059 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:21.946499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:21.947445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:21.947885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:21.948310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] PATH_INFO: `/v3/projects/1d0f937a94df4aa18f8bdcc66b99163d` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:21.949692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d0f937a94df4aa18f8bdcc66b99163d)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:21.952514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:21.954778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:21.960995 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 984/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:22.087496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d0f937a94df4aa18f8bdcc66b99163d', 'request_id': 'req-13ea9bea-450b-435f-a1b2-b7d44964af68'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.107511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d0f937a94df4aa18f8bdcc66b99163d', 'request_id': 'req-13ea9bea-450b-435f-a1b2-b7d44964af68'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.119969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d0f937a94df4aa18f8bdcc66b99163d', 'request_id': 'req-13ea9bea-450b-435f-a1b2-b7d44964af68'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.148224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] The token cache is being invalidate because project 1d0f937a94df4aa18f8bdcc66b99163d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:22.150324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.152605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.155498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 999/1983] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:21 2022] DELETE /identity/v3/projects/1d0f937a94df4aa18f8bdcc66b99163d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:22.159661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:22.187275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a4e9-6270-434c-84c5-ba407bf9946a service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:22.362698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:22.363679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:22.364152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:22.364601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] PATH_INFO: `/v3/users/44627d628ca846bdb11edd3d7c00f930` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:22.366197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44627d628ca846bdb11edd3d7c00f930)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:22.368624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:22.392192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:22.482301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44627d628ca846bdb11edd3d7c00f930'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.491517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44627d628ca846bdb11edd3d7c00f930'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.492250 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44627d628ca846bdb11edd3d7c00f930'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.492907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44627d628ca846bdb11edd3d7c00f930'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.511050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8981a3de-bb93-49ae-9513-b81a68ae0b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44627d628ca846bdb11edd3d7c00f930'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:22.565013 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 985/1984] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:22 2022] DELETE /identity/v3/users/44627d628ca846bdb11edd3d7c00f930 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:22.900224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:22.901682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:22.925552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea9bea-450b-435f-a1b2-b7d44964af68 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:23.027553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:23.029058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.029489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.029914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] PATH_INFO: `/v3/projects/bc4ab5aac2e04957b157f61a06140b1c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.031256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4ab5aac2e04957b157f61a06140b1c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:23.033837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:23.101678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4ab5aac2e04957b157f61a06140b1c', 'request_id': 'req-a2d30c2a-bdb2-4408-95c9-697af78f45f1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:23.115884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4ab5aac2e04957b157f61a06140b1c', 'request_id': 'req-a2d30c2a-bdb2-4408-95c9-697af78f45f1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:23.128293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4ab5aac2e04957b157f61a06140b1c', 'request_id': 'req-a2d30c2a-bdb2-4408-95c9-697af78f45f1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:23.150051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] The token cache is being invalidate because project bc4ab5aac2e04957b157f61a06140b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:23.150439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:23.151192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-a2d30c2a-bdb2-4408-95c9-697af78f45f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:23.152889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1000/1985] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:22 2022] DELETE /identity/v3/projects/bc4ab5aac2e04957b157f61a06140b1c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:29:23.161092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45cd78-4ae8-4bb7-9248-4aa3bb990dc0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.161563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45cd78-4ae8-4bb7-9248-4aa3bb990dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.161852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45cd78-4ae8-4bb7-9248-4aa3bb990dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.186726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-dd45cd78-4ae8-4bb7-9248-4aa3bb990dc0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:23.188301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-dd45cd78-4ae8-4bb7-9248-4aa3bb990dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:23.277867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 986/1986] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:23.287147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d0f1-f755-4969-908d-5d63d59f5210 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.287922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d0f1-f755-4969-908d-5d63d59f5210 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.288393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d0f1-f755-4969-908d-5d63d59f5210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.334067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-13d7d0f1-f755-4969-908d-5d63d59f5210 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:23.335761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-13d7d0f1-f755-4969-908d-5d63d59f5210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:23.348166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1001/1987] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:23.352686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45cd78-4ae8-4bb7-9248-4aa3bb990dc0 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:23.380438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45cd78-4ae8-4bb7-9248-4aa3bb990dc0 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:23.387450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:23.387952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.388287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.388560 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.389284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:23.389642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:23.391521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:23.409277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 987/1988] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:23.413823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7d0f1-f755-4969-908d-5d63d59f5210 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:23.424981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7d0f1-f755-4969-908d-5d63d59f5210 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:23.430657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:23.431529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.431931 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.432294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.433122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:23.435422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:23.458155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:23.484790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1002/1989] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:23 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:23.489008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:23.507762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60e838-3354-44e5-9d05-b5754c19ff6e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:23.619153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:23.619153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.619153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.619153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.619513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:23.619607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:23.660570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 988/1990] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:23 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:23.660932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:23.681404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e6d99-3a62-4c01-811d-d343ef380724 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:23.699297 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:23.699938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.700215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.700486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.701143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:23.702775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:23.721400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1003/1991] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:29:23.723347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:23.736726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb915f-29ea-4418-b83f-d6e731178bdc admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:23.752961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe9bd6-19f9-42f3-9271-92247507fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:23.754133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe9bd6-19f9-42f3-9271-92247507fa27 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.754858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe9bd6-19f9-42f3-9271-92247507fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.755545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe9bd6-19f9-42f3-9271-92247507fa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.756875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe9bd6-19f9-42f3-9271-92247507fa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:23.759532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe9bd6-19f9-42f3-9271-92247507fa27 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:23.761520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:23.784084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 989/1992] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:23.788355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:23.800933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122c1c-88dc-4947-a01c-f71923e2cff9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:23.809569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:23.811029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.811558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.812070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] PATH_INFO: `/v3/projects/43aeca33940143bb9ed77a6b33bb9a99/users/df4b4733b0874686ba465dfc3f0cd3f0/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.836633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43aeca33940143bb9ed77a6b33bb9a99, user_id=df4b4733b0874686ba465dfc3f0cd3f0, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:23.840547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:23.879278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1004/1993] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:23 2022] PUT /identity/v3/projects/43aeca33940143bb9ed77a6b33bb9a99/users/df4b4733b0874686ba465dfc3f0cd3f0/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:23.890897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:23.891224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:23.891460 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:23.927924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] MFA Rules not processed for user `df4b4733b0874686ba465dfc3f0cd3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:23.930315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:24.017239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 990/1994] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:24.029463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:24.032673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:24.106253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea804-fd96-4aeb-a816-08f561910ed8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:24.110666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3919187-28ec-41fb-a34e-9a04b970c8ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:24.111445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919187-28ec-41fb-a34e-9a04b970c8ac service glance] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:24.111729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919187-28ec-41fb-a34e-9a04b970c8ac service glance] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:24.112025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919187-28ec-41fb-a34e-9a04b970c8ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:24.123055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3919187-28ec-41fb-a34e-9a04b970c8ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:24.125417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3919187-28ec-41fb-a34e-9a04b970c8ac service glance] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:24.146005 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1005/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:24.972702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:24.974174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:25.072906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9db9-50de-4540-803e-c4d4ded7cbb9 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:25.078718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:25.079467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:25.079808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:25.080167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] PATH_INFO: `/v3/users/512be55cb8bf4ac39b93542b8d8b7ccf` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:25.081381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=512be55cb8bf4ac39b93542b8d8b7ccf)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:25.083601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:25.147446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512be55cb8bf4ac39b93542b8d8b7ccf'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:25.155523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512be55cb8bf4ac39b93542b8d8b7ccf'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:25.156527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512be55cb8bf4ac39b93542b8d8b7ccf'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:25.157154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512be55cb8bf4ac39b93542b8d8b7ccf'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:25.166225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512be55cb8bf4ac39b93542b8d8b7ccf'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:25.191691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 991/1996] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:24 2022] DELETE /identity/v3/users/512be55cb8bf4ac39b93542b8d8b7ccf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:25.193078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:25.193548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:25.193676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:25.220651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:25.221870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:25.299639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1006/1997] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:25.311372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:25.312835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:25.320201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:25.452104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc929f-b0d7-4905-8b77-921062b7fb15 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:25.456579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:25.457224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:25.457501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:25.457982 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:25.471882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:25.472130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:25.483677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 992/1998] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:26.147667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:26.150187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:26.170267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d81bc0-09c4-4db3-aed6-af47cca6d559 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:26.178008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:26.178929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:26.180279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:26.180713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] PATH_INFO: `/v3/projects/60d9161d469c439aa33ca1fa56cb9d8b` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:26.182573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d9161d469c439aa33ca1fa56cb9d8b)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:26.186157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:26.257490 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d9161d469c439aa33ca1fa56cb9d8b', 'request_id': 'req-dbb5ac1b-494e-4571-aad9-98a835849c80'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:26.262790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:26.271740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d9161d469c439aa33ca1fa56cb9d8b', 'request_id': 'req-dbb5ac1b-494e-4571-aad9-98a835849c80'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:26.280545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d9161d469c439aa33ca1fa56cb9d8b', 'request_id': 'req-dbb5ac1b-494e-4571-aad9-98a835849c80'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:26.292965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] The token cache is being invalidate because project 60d9161d469c439aa33ca1fa56cb9d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:26.293560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:26.294402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-dbb5ac1b-494e-4571-aad9-98a835849c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:26.296102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1007/1999] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:26 2022] DELETE /identity/v3/projects/60d9161d469c439aa33ca1fa56cb9d8b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:26.830194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:26.831673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:26.845953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abdfa9-9285-4530-8e9c-253f15d576ed service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:26.919232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:26.919952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:26.920208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:26.920486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] PATH_INFO: `/v3/users/2d51260174164ebc86fae9feed1f50e7` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:26.921896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d51260174164ebc86fae9feed1f50e7)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:26.924134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:26.996643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d51260174164ebc86fae9feed1f50e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.005695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d51260174164ebc86fae9feed1f50e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.006646 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d51260174164ebc86fae9feed1f50e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.007407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d51260174164ebc86fae9feed1f50e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.015853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d51260174164ebc86fae9feed1f50e7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.035643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 993/2000] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:26 2022] DELETE /identity/v3/users/2d51260174164ebc86fae9feed1f50e7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:27.041229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:27.041588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:27.041869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:27.064028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:27.065164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:27.135071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1008/2001] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:27.148749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:27.150302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:27.230456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:27.271201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f167a30-da8a-4d86-a409-ba3e6017f991 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:27.276544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:27.277212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:27.277450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:27.277893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:27.293617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:27.295301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:27.307235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 994/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:27.641095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:27.643314 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:27.658635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37cd7d-b183-46fa-b20c-73e8dace0097 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:27.664739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:27.665437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:27.665893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:27.666415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] PATH_INFO: `/v3/projects/08c88b0f839a4deab66cf6a5a84f8e84` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:27.667881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c88b0f839a4deab66cf6a5a84f8e84)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:27.670488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:27.730159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c88b0f839a4deab66cf6a5a84f8e84', 'request_id': 'req-76ea4322-0505-4099-98f0-37c789f90de4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.739868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c88b0f839a4deab66cf6a5a84f8e84', 'request_id': 'req-76ea4322-0505-4099-98f0-37c789f90de4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.747911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c88b0f839a4deab66cf6a5a84f8e84', 'request_id': 'req-76ea4322-0505-4099-98f0-37c789f90de4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.759045 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] The token cache is being invalidate because project 08c88b0f839a4deab66cf6a5a84f8e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:27.759434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.760256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-76ea4322-0505-4099-98f0-37c789f90de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:27.761796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1009/2003] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:27 2022] DELETE /identity/v3/projects/08c88b0f839a4deab66cf6a5a84f8e84 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:33.954176 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:33.963358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972e96e-3084-4681-b358-86e7a65000d8 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:34.015389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:34.016051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:34.016333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:34.016696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:34.018571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:34.094450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:34.095918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:34.106414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 995/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:37.335612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:37.339964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:37.340566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:37.371317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:37.373183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:37.497979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1010/2005] 10.222.0.16 () {58 vars in 967 bytes} [Tue Oct 11 13:29:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:37.511805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:37.513283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:37.600892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8466-4e25-436e-a995-08ad6593d404 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:37.615843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:37.615843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:37.615843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:37.615843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:37.624455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:37.626227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:37.638157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 996/2006] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:29:39.731610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:39.743779 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:39.760037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:39.822965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93ec52-d1f7-4130-95d2-1387efa1a9d1 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:39.827596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:39.828231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:39.828504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:39.828769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] PATH_INFO: `/v3/users/b3f2b7d5d25944e5a970fad1ee136f77` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:39.829912 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f2b7d5d25944e5a970fad1ee136f77)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:39.831857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:39.881892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f2b7d5d25944e5a970fad1ee136f77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:39.888932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f2b7d5d25944e5a970fad1ee136f77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:39.889595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f2b7d5d25944e5a970fad1ee136f77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:39.890193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f2b7d5d25944e5a970fad1ee136f77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:39.898580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9aaa3d6b-8dbd-4ba7-a66f-1c99da719482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f2b7d5d25944e5a970fad1ee136f77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:39.916855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1011/2007] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:39 2022] DELETE /identity/v3/users/b3f2b7d5d25944e5a970fad1ee136f77 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:40.101154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.113506 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03bb67-6e5a-4ac3-826c-a96392e54f99 service swift] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.120499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:40.203546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.204349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.205226 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.205692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] PATH_INFO: `/v3/projects/2cb847b356aa4788a94b96b03f58cb29` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.207045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb847b356aa4788a94b96b03f58cb29)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.209394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.260623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb847b356aa4788a94b96b03f58cb29', 'request_id': 'req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:40.268550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb847b356aa4788a94b96b03f58cb29', 'request_id': 'req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:40.276232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb847b356aa4788a94b96b03f58cb29', 'request_id': 'req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:40.287647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] The token cache is being invalidate because project 2cb847b356aa4788a94b96b03f58cb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:40.287917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:40.288567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-f21cd36d-3bd0-439a-aa93-7ab3c72a51a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:40.290279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 997/2008] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:40 2022] DELETE /identity/v3/projects/2cb847b356aa4788a94b96b03f58cb29 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:40.295261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515b9c-8a59-4b90-a5ee-bc0c7d8e1ec4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.295547 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515b9c-8a59-4b90-a5ee-bc0c7d8e1ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.295817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515b9c-8a59-4b90-a5ee-bc0c7d8e1ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.316599 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c7515b9c-8a59-4b90-a5ee-bc0c7d8e1ec4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:40.317920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c7515b9c-8a59-4b90-a5ee-bc0c7d8e1ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:40.388709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1012/2009] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:29:40.396391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54899161-5317-4abb-856e-49fd3aa3f199 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.396707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54899161-5317-4abb-856e-49fd3aa3f199 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.396992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54899161-5317-4abb-856e-49fd3aa3f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.417515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-54899161-5317-4abb-856e-49fd3aa3f199 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:40.419205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-54899161-5317-4abb-856e-49fd3aa3f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:40.427607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 998/2010] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:40.432407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515b9c-8a59-4b90-a5ee-bc0c7d8e1ec4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.442143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515b9c-8a59-4b90-a5ee-bc0c7d8e1ec4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.446785 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.447430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.447704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.447984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.448609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:40.448905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.450634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.466327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1013/2011] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:40.467890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54899161-5317-4abb-856e-49fd3aa3f199 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.477306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54899161-5317-4abb-856e-49fd3aa3f199 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.481966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.482566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.482887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.483168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.483826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.485755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.514618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 999/2012] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:40 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:29:40.519001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.529163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94461-6225-434a-aecd-94a48a1fe8f5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.541513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:40.595044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.596300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.596713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.596986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.597618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.599696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.622399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1014/2013] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:40 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:29:40.626374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.638205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95875ed-4ea5-4837-ab5a-b02b6fbc5a05 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.644334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.645053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.645396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.645728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.646434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.648268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.659790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1000/2014] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:40.663951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.674684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351262-9243-4336-bf4d-8ef66a43d786 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.680008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f907-e645-47b0-b673-20563db45322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.680632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f907-e645-47b0-b673-20563db45322 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.680906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f907-e645-47b0-b673-20563db45322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.681172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f907-e645-47b0-b673-20563db45322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.681818 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3f907-e645-47b0-b673-20563db45322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.683701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3f907-e645-47b0-b673-20563db45322 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.696149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1015/2015] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:40.700709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.711914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a2616-a0b6-4f39-894c-4c530c93fc92 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.716656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.717359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.717634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.717901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] PATH_INFO: `/v3/projects/3fdb9faf17764eea8a2fed9be98f5c43/users/c65705bde7f243b68785abdf0f8bda17/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.733500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdb9faf17764eea8a2fed9be98f5c43, user_id=c65705bde7f243b68785abdf0f8bda17, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.736726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.753316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1001/2016] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:40 2022] PUT /identity/v3/projects/3fdb9faf17764eea8a2fed9be98f5c43/users/c65705bde7f243b68785abdf0f8bda17/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:40.764686 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2979-28e5-48dd-a848-d63518e400cc None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.765169 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2979-28e5-48dd-a848-d63518e400cc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.765278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2979-28e5-48dd-a848-d63518e400cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.799511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-276d2979-28e5-48dd-a848-d63518e400cc None None] MFA Rules not processed for user `c65705bde7f243b68785abdf0f8bda17`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:40.800810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-276d2979-28e5-48dd-a848-d63518e400cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:40.870781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1016/2017] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:40.882379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:40.884230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:40.925916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:40.945465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46280af-1536-4f40-b9e5-52b64eeac5d7 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:40.949347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af175c-c9e3-4ae9-8cfc-5aa3882f0b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:40.949955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af175c-c9e3-4ae9-8cfc-5aa3882f0b85 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:40.950191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af175c-c9e3-4ae9-8cfc-5aa3882f0b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:40.950486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af175c-c9e3-4ae9-8cfc-5aa3882f0b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:40.959189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af175c-c9e3-4ae9-8cfc-5aa3882f0b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:40.960631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af175c-c9e3-4ae9-8cfc-5aa3882f0b85 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:40.969689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1002/2018] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:40.997323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2979-28e5-48dd-a848-d63518e400cc None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:41.060608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2979-28e5-48dd-a848-d63518e400cc None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:41.066375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:41.067043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.067316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.067587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] PATH_INFO: `/v3/users/c65705bde7f243b68785abdf0f8bda17` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.069072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65705bde7f243b68785abdf0f8bda17)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:41.071084 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:41.102731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:41.126217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65705bde7f243b68785abdf0f8bda17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.133394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65705bde7f243b68785abdf0f8bda17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.134056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65705bde7f243b68785abdf0f8bda17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.134652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65705bde7f243b68785abdf0f8bda17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.143219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65705bde7f243b68785abdf0f8bda17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.162883 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1017/2019] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:40 2022] DELETE /identity/v3/users/c65705bde7f243b68785abdf0f8bda17 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:41.167355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.167832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.167925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.187737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:41.188923 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:41.248939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1003/2020] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:41.259058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:41.260730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:41.318244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d16d1-3ce1-41d0-812e-fe55f08a1861 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:41.322119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83cfe8-5e5b-4627-8088-01f800d89a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:41.322742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cfe8-5e5b-4627-8088-01f800d89a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.323050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cfe8-5e5b-4627-8088-01f800d89a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.323322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cfe8-5e5b-4627-8088-01f800d89a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.332958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83cfe8-5e5b-4627-8088-01f800d89a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:41.334456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83cfe8-5e5b-4627-8088-01f800d89a16 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:41.345464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1018/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:41.669942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:41.671472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:41.684302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc362f7-ed66-45ab-829c-edf6519e96ac None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:41.689582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:41.690226 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.690491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.690763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] PATH_INFO: `/v3/projects/3fdb9faf17764eea8a2fed9be98f5c43` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.692687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdb9faf17764eea8a2fed9be98f5c43)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:41.694742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:41.746118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdb9faf17764eea8a2fed9be98f5c43', 'request_id': 'req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.755820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdb9faf17764eea8a2fed9be98f5c43', 'request_id': 'req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.762461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdb9faf17764eea8a2fed9be98f5c43', 'request_id': 'req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.772804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] The token cache is being invalidate because project 3fdb9faf17764eea8a2fed9be98f5c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:29:41.773090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.773748 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-024e8edf-da1e-4a3b-8d1c-7fbe55e5f0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:41.775369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1004/2022] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:41 2022] DELETE /identity/v3/projects/3fdb9faf17764eea8a2fed9be98f5c43 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:41.780473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223477-7fa9-4d5b-b84e-53b492721ced None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.780965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223477-7fa9-4d5b-b84e-53b492721ced None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.781082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223477-7fa9-4d5b-b84e-53b492721ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.802230 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-14223477-7fa9-4d5b-b84e-53b492721ced None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:41.803516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-14223477-7fa9-4d5b-b84e-53b492721ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:41.866959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1019/2023] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:41.875009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4549ca-d4cb-4fa1-b273-31543d6d3180 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.875295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4549ca-d4cb-4fa1-b273-31543d6d3180 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.875564 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4549ca-d4cb-4fa1-b273-31543d6d3180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.896594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-7f4549ca-d4cb-4fa1-b273-31543d6d3180 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:41.897805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7f4549ca-d4cb-4fa1-b273-31543d6d3180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:41.910959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1005/2024] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:41.916106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223477-7fa9-4d5b-b84e-53b492721ced None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:41.926738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223477-7fa9-4d5b-b84e-53b492721ced None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:41.932738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:41.933470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.933730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.933998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.934638 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:29:41.934969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:41.936569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:41.950752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1020/2025] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:29:41.955423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4549ca-d4cb-4fa1-b273-31543d6d3180 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:41.964990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4549ca-d4cb-4fa1-b273-31543d6d3180 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:41.971044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:41.971643 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:41.971914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:41.972178 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:41.972800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:41.974702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:42.005223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1006/2026] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:29:41 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:42.009661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:42.020075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4fc0-00a0-44f6-9cf3-41ae234efd64 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:42.055209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:42.082653 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:42.083324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:42.083510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:42.083820 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:42.084502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:42.086480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:42.109076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1021/2027] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:29:42 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:29:42.113282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:42.124234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5800f5-454f-4f07-8f9c-c260e93bc11a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:42.130187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:42.130794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:42.131192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:42.131581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:42.132310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:42.133889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:42.144001 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1007/2028] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:42.149491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:42.159908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e89823-8bbc-45ef-b02a-225e20ffd2d2 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:42.165736 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04717895-e32a-4e26-a94f-98d9991dbe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:42.166341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04717895-e32a-4e26-a94f-98d9991dbe02 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:42.166620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04717895-e32a-4e26-a94f-98d9991dbe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:42.166920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04717895-e32a-4e26-a94f-98d9991dbe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:42.167560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04717895-e32a-4e26-a94f-98d9991dbe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:42.169516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04717895-e32a-4e26-a94f-98d9991dbe02 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:42.179930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1022/2029] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:29:42.187821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:42.200435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e419ca8-3def-48ba-a0a5-25885e5acb26 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:42.206229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:42.206923 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:42.207203 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:42.207459 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] PATH_INFO: `/v3/projects/c17403ea310744939f52588f83a1bf10/users/d6b7b4e939474c1285438c29bd95e3c7/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:42.222486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17403ea310744939f52588f83a1bf10, user_id=d6b7b4e939474c1285438c29bd95e3c7, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:42.225496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:42.236088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:42.242726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1008/2030] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:29:42 2022] PUT /identity/v3/projects/c17403ea310744939f52588f83a1bf10/users/d6b7b4e939474c1285438c29bd95e3c7/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:42.253476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40b9b-b37c-4337-be36-c6fbcfc2e13e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:42.253767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40b9b-b37c-4337-be36-c6fbcfc2e13e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:42.254039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40b9b-b37c-4337-be36-c6fbcfc2e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:42.285027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-eaa40b9b-b37c-4337-be36-c6fbcfc2e13e None None] MFA Rules not processed for user `d6b7b4e939474c1285438c29bd95e3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:42.286241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-eaa40b9b-b37c-4337-be36-c6fbcfc2e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:42.357614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1023/2031] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:42.368853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:42.370704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:42.441136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eafb89-285f-4635-a8a5-340a8eeece71 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:42.447893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8c81b-8db9-4c39-9215-d2a96a78f1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:42.448737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8c81b-8db9-4c39-9215-d2a96a78f1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:42.449088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8c81b-8db9-4c39-9215-d2a96a78f1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:42.449354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8c81b-8db9-4c39-9215-d2a96a78f1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:42.460721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8c81b-8db9-4c39-9215-d2a96a78f1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:42.462149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8c81b-8db9-4c39-9215-d2a96a78f1a8 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:42.471913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1009/2032] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:43.844036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:43.844536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:43.844651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:43.864086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] MFA Rules not processed for user `d6b7b4e939474c1285438c29bd95e3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:43.865289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:43.872580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1024/2033] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:47.305496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78397e-667f-49c8-82e9-00ad3633bca8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:47.306066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78397e-667f-49c8-82e9-00ad3633bca8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:47.306173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78397e-667f-49c8-82e9-00ad3633bca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:47.327097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cc78397e-667f-49c8-82e9-00ad3633bca8 None None] MFA Rules not processed for user `18ae891c0f6742caaa94c3673f03628c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:47.328486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cc78397e-667f-49c8-82e9-00ad3633bca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:47.392298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1010/2034] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:53.859177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:57.384559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=52 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:59.226194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:59.227775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:59.300429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a92b-506c-4a38-af1a-bb5f96577ce0 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:59.305322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:59.305614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:59.305890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:59.306158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] PATH_INFO: `/v3/users/df4b4733b0874686ba465dfc3f0cd3f0` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:59.307305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4b4733b0874686ba465dfc3f0cd3f0)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:59.309440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:59.362375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4b4733b0874686ba465dfc3f0cd3f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:59.368977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4b4733b0874686ba465dfc3f0cd3f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:59.369659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4b4733b0874686ba465dfc3f0cd3f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:59.370253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4b4733b0874686ba465dfc3f0cd3f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:59.378777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4b4733b0874686ba465dfc3f0cd3f0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:29:59.396278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1025/2035] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:29:59 2022] DELETE /identity/v3/users/df4b4733b0874686ba465dfc3f0cd3f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:29:59.401088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:59.401560 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:59.401729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:59.422049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:29:59.423312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:59.485549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1011/2036] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:29:59.495581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:59.497259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:59.558155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72da6d-f6fb-438e-b048-13bfc366dc12 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:59.562228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d4df0-169b-4cb9-b8b8-e55c8be1dde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:59.562863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4df0-169b-4cb9-b8b8-e55c8be1dde3 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:59.563150 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4df0-169b-4cb9-b8b8-e55c8be1dde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:59.563420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4df0-169b-4cb9-b8b8-e55c8be1dde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:59.573143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d4df0-169b-4cb9-b8b8-e55c8be1dde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:59.574811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d4df0-169b-4cb9-b8b8-e55c8be1dde3 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:59.584487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1026/2037] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:29:59.917456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:29:59.919528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:29:59.932476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a39c-323b-4a5d-9404-3fdba89d1e1b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:29:59.937541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:29:59.938187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:29:59.938461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:29:59.938725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] PATH_INFO: `/v3/projects/43aeca33940143bb9ed77a6b33bb9a99` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:29:59.939885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43aeca33940143bb9ed77a6b33bb9a99)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:29:59.942534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:29:59.994987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43aeca33940143bb9ed77a6b33bb9a99', 'request_id': 'req-78111c38-4b6c-49d9-9cff-24e0577d3fd7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:00.002664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43aeca33940143bb9ed77a6b33bb9a99', 'request_id': 'req-78111c38-4b6c-49d9-9cff-24e0577d3fd7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:00.009795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43aeca33940143bb9ed77a6b33bb9a99', 'request_id': 'req-78111c38-4b6c-49d9-9cff-24e0577d3fd7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:00.020896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] The token cache is being invalidate because project 43aeca33940143bb9ed77a6b33bb9a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:30:00.021184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:00.021901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-78111c38-4b6c-49d9-9cff-24e0577d3fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:00.023454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1012/2038] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:29:59 2022] DELETE /identity/v3/projects/43aeca33940143bb9ed77a6b33bb9a99 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:30:00.028586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425ed2-db9a-42cf-8e9a-c6b771535bfe None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.028850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425ed2-db9a-42cf-8e9a-c6b771535bfe None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.029111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425ed2-db9a-42cf-8e9a-c6b771535bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.049481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-39425ed2-db9a-42cf-8e9a-c6b771535bfe None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:00.050843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-39425ed2-db9a-42cf-8e9a-c6b771535bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:00.068419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:00.117947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1027/2039] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:00.126319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85378-0d26-4786-a4c7-fcc68c41f891 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.126601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85378-0d26-4786-a4c7-fcc68c41f891 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.126909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85378-0d26-4786-a4c7-fcc68c41f891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.146928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4cf85378-0d26-4786-a4c7-fcc68c41f891 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:00.148113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4cf85378-0d26-4786-a4c7-fcc68c41f891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:00.156468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1013/2040] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:00.160781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425ed2-db9a-42cf-8e9a-c6b771535bfe None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:00.171049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425ed2-db9a-42cf-8e9a-c6b771535bfe None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:00.176074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:00.176683 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.176976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.177232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.177903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:30:00.178205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:00.179854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:00.192137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1028/2041] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:30:00.196352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85378-0d26-4786-a4c7-fcc68c41f891 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:00.206053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85378-0d26-4786-a4c7-fcc68c41f891 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:00.211175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:00.211782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.212057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.212322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.212949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:00.214973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:00.243640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1014/2042] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:30:00 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:30:00.247959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:00.260591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d7d9-2400-4d4e-8082-7c72d1b1ce2a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:00.321835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:00.322436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.322774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.323512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.323894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:00.325897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:00.355569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1029/2043] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:30:00 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:30:00.359842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:00.370567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bfc4b-7f0a-40d2-8384-a979d6260470 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:00.376279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:00.376888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.377163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.377431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.378082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:00.379729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:00.390083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1015/2044] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:30:00.394292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:00.404276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3559-1ba9-45fc-9f94-a0c1b147c518 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:00.410585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03622360-1b3b-4fad-a104-82f29af63d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:00.411351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622360-1b3b-4fad-a104-82f29af63d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.411605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622360-1b3b-4fad-a104-82f29af63d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.411875 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622360-1b3b-4fad-a104-82f29af63d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.412516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03622360-1b3b-4fad-a104-82f29af63d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:00.414167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03622360-1b3b-4fad-a104-82f29af63d5e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:00.429548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1030/2045] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:30:00.430763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:00.442057 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1244f6-85c6-481c-a8c5-092d7598d840 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:00.447127 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:00.447893 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.448230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.448525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] PATH_INFO: `/v3/projects/e6ec95568a944568b3bfdbb325ee8af8/users/8155e14c4b30424da62aa5fcb6e86a1d/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.465378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ec95568a944568b3bfdbb325ee8af8, user_id=8155e14c4b30424da62aa5fcb6e86a1d, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:00.468336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:00.483280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1016/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:30:00 2022] PUT /identity/v3/projects/e6ec95568a944568b3bfdbb325ee8af8/users/8155e14c4b30424da62aa5fcb6e86a1d/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:30:00.488291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6694d-9e03-47ea-8c6e-5245096bf8ab None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.488591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6694d-9e03-47ea-8c6e-5245096bf8ab None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.488886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6694d-9e03-47ea-8c6e-5245096bf8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.508394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-22a6694d-9e03-47ea-8c6e-5245096bf8ab None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:00.509512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-22a6694d-9e03-47ea-8c6e-5245096bf8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:00.568572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1031/2047] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:30:00.579952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:00.581880 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:00.606876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:00.652607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89a8f-38c8-4e6f-b277-9336a9dafe95 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:00.656170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:00.656807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:00.657078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:00.657342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:00.666102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:00.667621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:00.677045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1017/2048] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:30:01.530092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f079f8-d231-4afe-92f9-5004678bd004 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:01.530746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f079f8-d231-4afe-92f9-5004678bd004 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:01.530746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f079f8-d231-4afe-92f9-5004678bd004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:01.560837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a6f079f8-d231-4afe-92f9-5004678bd004 None None] MFA Rules not processed for user `8155e14c4b30424da62aa5fcb6e86a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:01.562044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a6f079f8-d231-4afe-92f9-5004678bd004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:01.578219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:01.628821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1032/2049] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:01.640218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:01.642054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:01.703945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834cc-a6a5-4baf-96ad-74c3ab6a521e service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:01.707821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142ab2-f424-4837-933e-39cd3eff7a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:01.708448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142ab2-f424-4837-933e-39cd3eff7a30 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:01.708745 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142ab2-f424-4837-933e-39cd3eff7a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:01.709018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142ab2-f424-4837-933e-39cd3eff7a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:01.717876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142ab2-f424-4837-933e-39cd3eff7a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:01.719352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142ab2-f424-4837-933e-39cd3eff7a30 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:01.728307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1018/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:30:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:30:03.114253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:03.114772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:03.114896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:03.135676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] MFA Rules not processed for user `8155e14c4b30424da62aa5fcb6e86a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:03.137091 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:03.147474 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1033/2051] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:05.024062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38d7c-1928-4777-a282-e84eb3d78904 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:05.024644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38d7c-1928-4777-a282-e84eb3d78904 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:05.024644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38d7c-1928-4777-a282-e84eb3d78904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:05.044514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-81b38d7c-1928-4777-a282-e84eb3d78904 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:05.045725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-81b38d7c-1928-4777-a282-e84eb3d78904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:05.104098 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1019/2052] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:30:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:05.117462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:05.119316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:05.196530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663c2f-102f-4074-a680-1b9c8a6a7e81 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:05.201799 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:05.202417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:05.202694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:05.202998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:05.216014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:05.217698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:05.226526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1034/2053] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:30:05.874991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c8a4-fb3f-40fd-88f4-ef21c61af602 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:05.876065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c8a4-fb3f-40fd-88f4-ef21c61af602 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:05.876451 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c8a4-fb3f-40fd-88f4-ef21c61af602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:05.900652 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e2d0c8a4-fb3f-40fd-88f4-ef21c61af602 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:05.901754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e2d0c8a4-fb3f-40fd-88f4-ef21c61af602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:05.910363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1020/2054] 10.222.0.16 () {58 vars in 967 bytes} [Tue Oct 11 13:30:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:05.925100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:05.937380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94e73-3c9c-467e-95ef-3c6fcf4f23ce service swift] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:05.943116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:05.943919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:05.944263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:05.944723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:05.955324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:05.956977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:05.967275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1035/2055] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 13:30:06.341734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8acd5-9553-4686-8a96-4dccf7b7587e None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:06.342464 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8acd5-9553-4686-8a96-4dccf7b7587e None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:06.342934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8acd5-9553-4686-8a96-4dccf7b7587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:06.364156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b7d8acd5-9553-4686-8a96-4dccf7b7587e None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:06.365372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b7d8acd5-9553-4686-8a96-4dccf7b7587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:06.374805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1021/2056] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:30:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:06.389660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:06.401325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df5a6c-c21e-4a5e-93c3-3aa987c8c28b service swift] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:06.406574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:06.407886 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:06.408171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:06.408440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:06.421260 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:06.423486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:06.433444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1036/2057] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:30:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:30:06.857361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:06.857857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:06.858288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:06.890184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:06.891960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:06.901304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1022/2058] 10.222.0.16 () {58 vars in 967 bytes} [Tue Oct 11 13:30:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:30:06.920719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:06.937568 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980688-f7d9-4fdd-a694-4b2f632e93fa service swift] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:06.947548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1762-6a4f-4393-9fb3-345368577be1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:06.948573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1762-6a4f-4393-9fb3-345368577be1 service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:06.949142 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1762-6a4f-4393-9fb3-345368577be1 service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:06.949923 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1762-6a4f-4393-9fb3-345368577be1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:06.965585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1762-6a4f-4393-9fb3-345368577be1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:06.969186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1762-6a4f-4393-9fb3-345368577be1 service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:06.987383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1037/2059] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:30:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:30:09.388345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:09.389899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:09.405768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538fcd9-545a-48c7-b827-903fb6094b93 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:09.411987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:09.412585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:09.412859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:09.413312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] PATH_INFO: `/v3/users/d6b7b4e939474c1285438c29bd95e3c7` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:09.414467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b7b4e939474c1285438c29bd95e3c7)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:09.416417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:09.465906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:09.467878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b7b4e939474c1285438c29bd95e3c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:09.477083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b7b4e939474c1285438c29bd95e3c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:09.477950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b7b4e939474c1285438c29bd95e3c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:09.478734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b7b4e939474c1285438c29bd95e3c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:09.488168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b7b4e939474c1285438c29bd95e3c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:09.508133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1023/2060] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:30:09 2022] DELETE /identity/v3/users/d6b7b4e939474c1285438c29bd95e3c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:30:09.513119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:09.513688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:09.514099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:09.537113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:09.538425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:09.602063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1038/2061] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:09.612223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:09.613820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:09.676650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199ec4f-2cae-4028-b1f6-1228ca42e35b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:09.680340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9272ca-0c59-4d4c-bd27-6371867b959b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:09.680969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9272ca-0c59-4d4c-bd27-6371867b959b service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:09.681244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9272ca-0c59-4d4c-bd27-6371867b959b service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:09.681514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9272ca-0c59-4d4c-bd27-6371867b959b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:09.692391 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9272ca-0c59-4d4c-bd27-6371867b959b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:09.693817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9272ca-0c59-4d4c-bd27-6371867b959b service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:09.704372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1024/2062] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:30:09.929320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:09.930916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:09.938450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:09.944913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce7755-8e22-4463-84e7-e3ef59834f02 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:09.959788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:09.960451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:09.961157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:09.961452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] PATH_INFO: `/v3/projects/c17403ea310744939f52588f83a1bf10` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:09.962628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17403ea310744939f52588f83a1bf10)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:09.964999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.016055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17403ea310744939f52588f83a1bf10', 'request_id': 'req-5149d009-2734-4357-a061-a7041d593189'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:10.024996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17403ea310744939f52588f83a1bf10', 'request_id': 'req-5149d009-2734-4357-a061-a7041d593189'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:10.032141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17403ea310744939f52588f83a1bf10', 'request_id': 'req-5149d009-2734-4357-a061-a7041d593189'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:10.047756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] The token cache is being invalidate because project c17403ea310744939f52588f83a1bf10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:30:10.048111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:10.048853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5149d009-2734-4357-a061-a7041d593189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:30:10.050423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1039/2063] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:30:09 2022] DELETE /identity/v3/projects/c17403ea310744939f52588f83a1bf10 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:30:10.055540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1bf8-0f30-4f29-b67e-e45c73617aed None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.055817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1bf8-0f30-4f29-b67e-e45c73617aed None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.056082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1bf8-0f30-4f29-b67e-e45c73617aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.075852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-bbef1bf8-0f30-4f29-b67e-e45c73617aed None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:10.077030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bbef1bf8-0f30-4f29-b67e-e45c73617aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:10.145636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1025/2064] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:30:10.153465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135458-f620-4e8f-b772-e2457d53c6a4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.153784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135458-f620-4e8f-b772-e2457d53c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.154064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135458-f620-4e8f-b772-e2457d53c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.175765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-38135458-f620-4e8f-b772-e2457d53c6a4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:10.176959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-38135458-f620-4e8f-b772-e2457d53c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:10.186518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1040/2065] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:10.191356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1bf8-0f30-4f29-b67e-e45c73617aed None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:10.207213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1bf8-0f30-4f29-b67e-e45c73617aed None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:10.213402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:10.214000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.214279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.214570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.215237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:30:10.215546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:10.217283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.229698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1026/2066] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:30:10.234294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38135458-f620-4e8f-b772-e2457d53c6a4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:10.243862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38135458-f620-4e8f-b772-e2457d53c6a4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:10.248925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:10.249536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.249811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.250075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.250691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:10.252628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.282072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1041/2067] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:30:10 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:30:10.286908 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:10.300651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421dee2-761e-4feb-9b75-bf1d6e0d42d3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:10.356530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:10.367789 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:10.368426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.368690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.368962 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.369598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:10.371572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.395199 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1027/2068] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:30:10 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:30:10.399405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:10.409497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189df6-cf63-4917-9e2f-4e2d6b081472 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:10.414022 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:10.414616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.414929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.415197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.415832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:10.417451 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.427827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1042/2069] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:30:10.431815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:10.442324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767bdb-9099-4fd3-aafc-9f5663f95c62 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:10.447556 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edcff3-59a5-4615-99a7-79def7f5c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:10.448180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edcff3-59a5-4615-99a7-79def7f5c6df admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.448451 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edcff3-59a5-4615-99a7-79def7f5c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.448694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edcff3-59a5-4615-99a7-79def7f5c6df admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.449326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edcff3-59a5-4615-99a7-79def7f5c6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:10.451050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edcff3-59a5-4615-99a7-79def7f5c6df admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.461508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1028/2070] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:30:10.465661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:10.475908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b72ee-4a37-4811-8cdf-6399da358fc5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:10.481043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:10.481688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.482382 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.482773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] PATH_INFO: `/v3/projects/0aeb31f2ac384c42bca1e3084475b851/users/cefda31dec244f9eb150decabc7d2a29/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.498386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aeb31f2ac384c42bca1e3084475b851, user_id=cefda31dec244f9eb150decabc7d2a29, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:10.501557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.517367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1043/2071] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:30:10 2022] PUT /identity/v3/projects/0aeb31f2ac384c42bca1e3084475b851/users/cefda31dec244f9eb150decabc7d2a29/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:30:10.523771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8808a-28f0-4212-bada-717c00795496 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.524056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8808a-28f0-4212-bada-717c00795496 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.524328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8808a-28f0-4212-bada-717c00795496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.545298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-00d8808a-28f0-4212-bada-717c00795496 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:10.546529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-00d8808a-28f0-4212-bada-717c00795496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:10.611225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1029/2072] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:10.622804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:10.624934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:10.684822 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8085c-a2e8-41c0-9431-7d69c6d5253e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:10.688993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:10.689643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:10.689922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:10.690194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:10.699530 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:10.701212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:10.711036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1044/2073] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:30:16.042743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f020bdc-2102-46f5-8cf7-0009fb7b6197 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:16.043777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f020bdc-2102-46f5-8cf7-0009fb7b6197 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:16.044473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f020bdc-2102-46f5-8cf7-0009fb7b6197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:16.082426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4f020bdc-2102-46f5-8cf7-0009fb7b6197 None None] MFA Rules not processed for user `cefda31dec244f9eb150decabc7d2a29`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:16.084304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4f020bdc-2102-46f5-8cf7-0009fb7b6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:16.170754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1030/2074] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:16.175375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:16.186786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee87ca-62c7-444d-9ac2-9a839ed45f75 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:16.191780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:16.192422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:16.192805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:16.192952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:16.194891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:16.195571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:16.228271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1045/2075] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:30:16 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:30:16.229449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f020bdc-2102-46f5-8cf7-0009fb7b6197 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:16.241502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f020bdc-2102-46f5-8cf7-0009fb7b6197 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:16.309697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:16.310392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:16.310551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:16.310857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:16.312629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:16.313498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:16.368802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:16.394601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1031/2076] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:30:16 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:30:16.397520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:16.403540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:16.409744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0df9-4773-438a-aeae-26743d124691 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:16.417772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:16.420180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:16.420885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:16.421384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:16.422065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:16.423769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:16.435863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1046/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:30:16.439849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:16.454191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543f624-bcb5-4ea2-ada7-69d2d57d1c91 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:16.461443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:16.462179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:16.462727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:16.463077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] PATH_INFO: `/v3/projects/30a282f7ad8d4b8a93a9e43d98150ead/users/e5f5b31151a64889947638e271ed2c15/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:16.486051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a282f7ad8d4b8a93a9e43d98150ead, user_id=e5f5b31151a64889947638e271ed2c15, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:16.489645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:16.508709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1032/2078] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:30:16 2022] PUT /identity/v3/projects/30a282f7ad8d4b8a93a9e43d98150ead/users/e5f5b31151a64889947638e271ed2c15/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:30:16.512897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:16.529646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7ee87-1fd1-4c00-b76f-3ebe451c5304 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:16.623958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:16.624714 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:16.625078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:16.625414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:16.626140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:16.628376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:16.644186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1047/2079] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:30:16.648299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:16.676691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e646-0a2f-4d9f-818f-c10d24b51dfd admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:16.693119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249401e-3c77-4d73-9896-ba63ab54f749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:16.694022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249401e-3c77-4d73-9896-ba63ab54f749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:16.694364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249401e-3c77-4d73-9896-ba63ab54f749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:16.694998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249401e-3c77-4d73-9896-ba63ab54f749 admin admin] PATH_INFO: `/v3/projects/30a282f7ad8d4b8a93a9e43d98150ead/users/e5f5b31151a64889947638e271ed2c15/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:16.697305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249401e-3c77-4d73-9896-ba63ab54f749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a282f7ad8d4b8a93a9e43d98150ead, user_id=e5f5b31151a64889947638e271ed2c15, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:16.700778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249401e-3c77-4d73-9896-ba63ab54f749 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:16.720216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1033/2080] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:30:16 2022] PUT /identity/v3/projects/30a282f7ad8d4b8a93a9e43d98150ead/users/e5f5b31151a64889947638e271ed2c15/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:30:17.356776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:17.358961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:17.477859 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca201d4-8f58-4e99-818d-1171e71ed2b3 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:17.580178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:17.581165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:17.581648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:17.582065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:17.584496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:17.600396 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:17.602737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:17.628536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1048/2081] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:30:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:30:22.738581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a1d8a-dbed-4063-8546-202b0f116754 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:22.739029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a1d8a-dbed-4063-8546-202b0f116754 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:22.739312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a1d8a-dbed-4063-8546-202b0f116754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:22.777048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-050a1d8a-dbed-4063-8546-202b0f116754 None None] MFA Rules not processed for user `e5f5b31151a64889947638e271ed2c15`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:22.778432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-050a1d8a-dbed-4063-8546-202b0f116754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:22.901361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1034/2082] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:22.914560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:22.916081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:22.947628 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:22.985434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde1596-a216-406b-ba79-361d3c03e540 service placement] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:22.989254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:22.989876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:22.990145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:22.990422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:23.062962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:23.064435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:23.073992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1049/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:30:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:30:23.226517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff94e5-3f89-499e-b372-0febebb45c74 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:23.226801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff94e5-3f89-499e-b372-0febebb45c74 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:23.227128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff94e5-3f89-499e-b372-0febebb45c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:23.248103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a3ff94e5-3f89-499e-b372-0febebb45c74 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:23.249463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a3ff94e5-3f89-499e-b372-0febebb45c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:23.310968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1035/2084] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:30:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:23.334400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:23.336267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:23.417908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099d59-527d-470b-8866-6bd02d1fcc31 service glance] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:23.424908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d66836-84f4-48d7-bc6f-2e0cdf12d23d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:23.425548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66836-84f4-48d7-bc6f-2e0cdf12d23d service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:23.425852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66836-84f4-48d7-bc6f-2e0cdf12d23d service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:23.426155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66836-84f4-48d7-bc6f-2e0cdf12d23d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:23.435057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d66836-84f4-48d7-bc6f-2e0cdf12d23d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:23.436692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d66836-84f4-48d7-bc6f-2e0cdf12d23d service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:23.445298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1050/2085] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:30:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 13:30:33.304043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:INSERT=4,keystone:SELECT=76 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:33.441664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=71 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:33.720862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff928c-413c-481c-a183-9a3ef1cf8f65 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:33.721179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff928c-413c-481c-a183-9a3ef1cf8f65 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:33.721455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff928c-413c-481c-a183-9a3ef1cf8f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:33.743180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-03ff928c-413c-481c-a183-9a3ef1cf8f65 None None] MFA Rules not processed for user `cefda31dec244f9eb150decabc7d2a29`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:33.745142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-03ff928c-413c-481c-a183-9a3ef1cf8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:33.752678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1036/2086] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:30:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:36.427093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0c8f-260d-4957-bbab-975a94a2e25b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:36.429282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0c8f-260d-4957-bbab-975a94a2e25b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:36.432913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0c8f-260d-4957-bbab-975a94a2e25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:36.480512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d85d0c8f-260d-4957-bbab-975a94a2e25b None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:36.481913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d85d0c8f-260d-4957-bbab-975a94a2e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:36.497692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1051/2087] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:30:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:36.515677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff928c-413c-481c-a183-9a3ef1cf8f65 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:36.530259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff928c-413c-481c-a183-9a3ef1cf8f65 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:36.541602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:36.542979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:36.543422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:36.543985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:36.556802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:36.558502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:36.571043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1037/2088] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:30:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:30:46.472219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:46.566050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=9 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:54.062952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06cd1d-5899-49d7-8b3e-167fbe5f7610 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:54.063541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06cd1d-5899-49d7-8b3e-167fbe5f7610 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:54.063541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06cd1d-5899-49d7-8b3e-167fbe5f7610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:54.107564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-aa06cd1d-5899-49d7-8b3e-167fbe5f7610 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:54.108666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-aa06cd1d-5899-49d7-8b3e-167fbe5f7610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:54.123018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1052/2089] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:30:54.134010 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:54.146975 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811b633-9f3b-421d-9877-3af192713252 service swift] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:54.167003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:54.167753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:54.168254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:54.168530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:54.179218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:54.181097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:54.190252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1038/2090] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:30:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:30:56.807631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355d03-2d51-46b3-89d0-44712e00c79b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:56.808610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355d03-2d51-46b3-89d0-44712e00c79b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:56.808884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355d03-2d51-46b3-89d0-44712e00c79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:56.830357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-db355d03-2d51-46b3-89d0-44712e00c79b None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:30:56.832052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-db355d03-2d51-46b3-89d0-44712e00c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:56.910752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1053/2091] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:30:56.926847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:30:56.928526 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:30:57.014151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff9d9-8d45-4253-bed6-a7ab377b42f4 service swift] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:30:57.019884 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:30:57.020549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:30:57.020828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:30:57.021097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:30:57.031246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:30:57.032868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:30:57.043085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1039/2092] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:03.893724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1635-2fea-42ec-98af-c31b9921f6cc None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:03.894351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1635-2fea-42ec-98af-c31b9921f6cc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:03.894351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1635-2fea-42ec-98af-c31b9921f6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:03.925677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ab2d1635-2fea-42ec-98af-c31b9921f6cc None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:03.927071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ab2d1635-2fea-42ec-98af-c31b9921f6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:03.936814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1054/2093] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:03.951204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:03.964825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4308f5d-6c56-4204-8e11-1798fa93ff6c service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:03.973142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:03.973761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:03.974208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:03.975447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:03.984571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:03.986165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:03.996915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1040/2094] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:09.289049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03681-3a0d-4c93-9838-0a28dc9e9593 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:09.289517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03681-3a0d-4c93-9838-0a28dc9e9593 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:09.289759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03681-3a0d-4c93-9838-0a28dc9e9593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:09.315221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-83b03681-3a0d-4c93-9838-0a28dc9e9593 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:09.316442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-83b03681-3a0d-4c93-9838-0a28dc9e9593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:09.328517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1055/2095] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:09.343502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:09.345345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:09.363457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d973883-92e5-4c83-91bd-350df837dff6 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:09.369196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2c54-2c87-4173-b20b-889e707fcc71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:09.369827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2c54-2c87-4173-b20b-889e707fcc71 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:09.370107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2c54-2c87-4173-b20b-889e707fcc71 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:09.370378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2c54-2c87-4173-b20b-889e707fcc71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:09.379855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2c54-2c87-4173-b20b-889e707fcc71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:09.381728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2c54-2c87-4173-b20b-889e707fcc71 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:09.393720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1041/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:11.926476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce292d08-89ca-409d-a6be-52c5e93bb1db None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:11.927057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce292d08-89ca-409d-a6be-52c5e93bb1db None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:11.927185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce292d08-89ca-409d-a6be-52c5e93bb1db None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:11.928596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1056/2097] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:31:11.935263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208ea07-7e64-4918-987d-4dee85c163b3 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:11.935764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208ea07-7e64-4918-987d-4dee85c163b3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:11.935869 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208ea07-7e64-4918-987d-4dee85c163b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:11.956520 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6208ea07-7e64-4918-987d-4dee85c163b3 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:11.957750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6208ea07-7e64-4918-987d-4dee85c163b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:11.967353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1042/2098] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:11.979150 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce292d08-89ca-409d-a6be-52c5e93bb1db None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:11.980978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ce292d08-89ca-409d-a6be-52c5e93bb1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:11.994586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce292d08-89ca-409d-a6be-52c5e93bb1db None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:11.998292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c3c3e-9bf7-4dc0-922c-58eda8ffcb01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:11.998937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3c3e-9bf7-4dc0-922c-58eda8ffcb01 service glance] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:11.999224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3c3e-9bf7-4dc0-922c-58eda8ffcb01 service glance] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:11.999494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3c3e-9bf7-4dc0-922c-58eda8ffcb01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:12.009910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3c3e-9bf7-4dc0-922c-58eda8ffcb01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:12.011591 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3c3e-9bf7-4dc0-922c-58eda8ffcb01 service glance] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:12.022447 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1057/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:12.097297 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a20d4c-47d1-4af3-8c31-741aa75622fa None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:12.097649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a20d4c-47d1-4af3-8c31-741aa75622fa None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:12.097896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a20d4c-47d1-4af3-8c31-741aa75622fa None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:12.099431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1043/2100] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:31:12.104357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeb75a-a2b9-4232-a8ba-2a1099bb582b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:12.104671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeb75a-a2b9-4232-a8ba-2a1099bb582b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:12.104941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeb75a-a2b9-4232-a8ba-2a1099bb582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:12.124575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-8fbeb75a-a2b9-4232-a8ba-2a1099bb582b None None] MFA Rules not processed for user `ed8635b4ce034605bcce301f3f98e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:12.125831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8fbeb75a-a2b9-4232-a8ba-2a1099bb582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:12.177938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1058/2101] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:31:12.190496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a20d4c-47d1-4af3-8c31-741aa75622fa None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:12.203322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a20d4c-47d1-4af3-8c31-741aa75622fa None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:12.207979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210abbb4-67ad-4186-8e3e-8f19f97a84ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:12.208588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210abbb4-67ad-4186-8e3e-8f19f97a84ef service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:12.208865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210abbb4-67ad-4186-8e3e-8f19f97a84ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:12.209133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210abbb4-67ad-4186-8e3e-8f19f97a84ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:12.216986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210abbb4-67ad-4186-8e3e-8f19f97a84ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:12.218444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210abbb4-67ad-4186-8e3e-8f19f97a84ef service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:12.226676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1044/2102] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:12.316065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e06a4-d9a9-404a-83ae-811c81bf47c3 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:12.316316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e06a4-d9a9-404a-83ae-811c81bf47c3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:12.316626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e06a4-d9a9-404a-83ae-811c81bf47c3 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:12.318009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1059/2103] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:31:12.323090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc49b-7e50-4294-bdf5-58e1a1179180 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:12.323325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc49b-7e50-4294-bdf5-58e1a1179180 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:12.323625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc49b-7e50-4294-bdf5-58e1a1179180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:12.344989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-f32cc49b-7e50-4294-bdf5-58e1a1179180 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:12.346228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f32cc49b-7e50-4294-bdf5-58e1a1179180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:12.356366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1045/2104] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:12.367824 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e06a4-d9a9-404a-83ae-811c81bf47c3 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:12.369540 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-853e06a4-d9a9-404a-83ae-811c81bf47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:12.382694 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e06a4-d9a9-404a-83ae-811c81bf47c3 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:12.388737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:12.389541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:12.389858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:12.390272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:12.402752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:12.404463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:12.417311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1060/2105] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:14.452406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737531-4633-4fdb-940a-3123bd8eb30a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:14.453030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737531-4633-4fdb-940a-3123bd8eb30a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:14.453030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737531-4633-4fdb-940a-3123bd8eb30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:14.479928 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-cd737531-4633-4fdb-940a-3123bd8eb30a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:14.482144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cd737531-4633-4fdb-940a-3123bd8eb30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:14.492398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1046/2106] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:14.511441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:14.530092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16bd8b-b7d3-4a40-8a00-d5c5c8cdb08f service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:14.553078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9a507-9c9a-43f5-8b8a-8ca9e86cf910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:14.553863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a507-9c9a-43f5-8b8a-8ca9e86cf910 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:14.554211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a507-9c9a-43f5-8b8a-8ca9e86cf910 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:14.554595 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a507-9c9a-43f5-8b8a-8ca9e86cf910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:14.588161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9a507-9c9a-43f5-8b8a-8ca9e86cf910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:14.595158 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9a507-9c9a-43f5-8b8a-8ca9e86cf910 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:14.617164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1061/2107] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:14.903277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd737531-4633-4fdb-940a-3123bd8eb30a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:14.913760 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd737531-4633-4fdb-940a-3123bd8eb30a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:14.917444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:14.918052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:14.918325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:14.918592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:14.928302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:14.929719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:14.939758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1047/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:18.889918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe2aa-652c-4dbc-8182-2788f4247759 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:18.890509 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe2aa-652c-4dbc-8182-2788f4247759 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:18.890652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe2aa-652c-4dbc-8182-2788f4247759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:18.917810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=78 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:18.940155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-4f1fe2aa-652c-4dbc-8182-2788f4247759 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:18.941506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4f1fe2aa-652c-4dbc-8182-2788f4247759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:18.953122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1062/2109] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:31:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:18.967840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:18.975016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=74 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:18.984693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf62c-e7a3-4685-a705-0c1d3e44cb43 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:18.990993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:18.991858 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:18.992867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:18.993337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:19.003727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:19.005420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:19.035068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1048/2110] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:31:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:31:19.706696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c76ce-1beb-42af-9c0e-20c34fc9bb78 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:19.707025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c76ce-1beb-42af-9c0e-20c34fc9bb78 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:19.707303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c76ce-1beb-42af-9c0e-20c34fc9bb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:19.728345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-275c76ce-1beb-42af-9c0e-20c34fc9bb78 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:19.729761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-275c76ce-1beb-42af-9c0e-20c34fc9bb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:19.738791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1063/2111] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:19.777265 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:19.789793 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f39b-1b92-484b-a931-a58a0433bf70 service swift] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:19.796421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:19.797032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:19.797309 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:19.797579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:19.806523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:19.808336 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:19.819136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1049/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:29.723179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:29.814719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=11 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:41.517643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cfde5-90b1-4abc-8c93-e681cc99ae81 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:41.518218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cfde5-90b1-4abc-8c93-e681cc99ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:41.518651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cfde5-90b1-4abc-8c93-e681cc99ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:41.539570 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-418cfde5-90b1-4abc-8c93-e681cc99ae81 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:41.540762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-418cfde5-90b1-4abc-8c93-e681cc99ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:41.550514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1064/2113] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:41.692795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:41.705334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222f324-bd87-4b93-b335-e8cc74167474 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:41.711621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:41.712230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:41.712552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:41.712821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:41.721828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:41.724017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:41.733754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1050/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:31:44.733059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737220fb-5dae-4e1d-afff-3e4c82aec9dd None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:44.733517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737220fb-5dae-4e1d-afff-3e4c82aec9dd None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:44.733629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737220fb-5dae-4e1d-afff-3e4c82aec9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:44.755563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-737220fb-5dae-4e1d-afff-3e4c82aec9dd None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:44.757002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-737220fb-5dae-4e1d-afff-3e4c82aec9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:44.765673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1065/2115] 10.222.0.16 () {58 vars in 967 bytes} [Tue Oct 11 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:31:44.788344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:31:44.800103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b2e1-190c-4ed1-8c42-a140101fbc68 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:31:44.805180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2abcdf-51ac-447c-a9d9-8744dbb89df5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:31:44.806306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2abcdf-51ac-447c-a9d9-8744dbb89df5 service swift] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:44.806306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2abcdf-51ac-447c-a9d9-8744dbb89df5 service swift] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:44.806500 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2abcdf-51ac-447c-a9d9-8744dbb89df5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:44.815087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2abcdf-51ac-447c-a9d9-8744dbb89df5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:31:44.816649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2abcdf-51ac-447c-a9d9-8744dbb89df5 service swift] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:31:44.824966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1051/2116] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 13:31:54.750116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:54.821945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=12 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:59.099672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:31:59.100176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:31:59.100290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:31:59.124409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] MFA Rules not processed for user `8155e14c4b30424da62aa5fcb6e86a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:31:59.126360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:31:59.192113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1066/2117] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:31:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:32:09.184498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=25 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:10.396058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf01e9-39a1-44d3-b96f-787182a8b3a5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:10.396885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf01e9-39a1-44d3-b96f-787182a8b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:10.396885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf01e9-39a1-44d3-b96f-787182a8b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:10.421634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b2bf01e9-39a1-44d3-b96f-787182a8b3a5 None None] MFA Rules not processed for user `18ae891c0f6742caaa94c3673f03628c`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:32:10.423339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b2bf01e9-39a1-44d3-b96f-787182a8b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:10.492287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1052/2118] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:32:15.004543 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:15.005986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:15.065434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af676eb7-8d3d-4405-bf2f-7c8e4084148b None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:15.069087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6b921-4b15-4740-88f9-796c912a0562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:15.069699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6b921-4b15-4740-88f9-796c912a0562 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:15.069975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6b921-4b15-4740-88f9-796c912a0562 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:15.070241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6b921-4b15-4740-88f9-796c912a0562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:15.072016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3ec6b921-4b15-4740-88f9-796c912a0562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:15.086046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6b921-4b15-4740-88f9-796c912a0562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:15.087798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6b921-4b15-4740-88f9-796c912a0562 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:15.098680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1067/2119] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:15.475579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf01e9-39a1-44d3-b96f-787182a8b3a5 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:15.487082 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf01e9-39a1-44d3-b96f-787182a8b3a5 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:15.491625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:15.492262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:15.492536 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:15.492857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:15.495392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:15.511046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:15.512403 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:15.524181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1053/2120] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:17.769362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cdc26-7ac9-4c46-8add-21a371aa2c8a None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:17.770156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cdc26-7ac9-4c46-8add-21a371aa2c8a None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:17.773384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cdc26-7ac9-4c46-8add-21a371aa2c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:17.802740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e33cdc26-7ac9-4c46-8add-21a371aa2c8a None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:32:17.804044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e33cdc26-7ac9-4c46-8add-21a371aa2c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:17.815866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1068/2121] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:32:17.832157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:17.846675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d034caf-0f64-435a-aeab-b6a4d46f222c service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:17.852790 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:17.853683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:17.854190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:17.854428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:17.863795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:17.865557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:17.877040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1054/2122] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:32:22.083460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a620-3682-480f-9842-605029977371 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:22.083990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a620-3682-480f-9842-605029977371 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:22.083990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a620-3682-480f-9842-605029977371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:22.104749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-42a2a620-3682-480f-9842-605029977371 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:32:22.105793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-42a2a620-3682-480f-9842-605029977371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:22.113936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1069/2123] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:32:22.127941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:22.140409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7427cfe-78e5-4306-882b-57f4b82ae964 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:22.145977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:22.146581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:22.146896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:22.147167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:22.156371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:22.157999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:22.168119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1055/2124] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:26.214358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68c1f-f14a-4aea-9241-3cd164cc121f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:26.214894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68c1f-f14a-4aea-9241-3cd164cc121f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:26.214894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68c1f-f14a-4aea-9241-3cd164cc121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:26.236695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-12b68c1f-f14a-4aea-9241-3cd164cc121f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:32:26.238446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-12b68c1f-f14a-4aea-9241-3cd164cc121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:26.249607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1070/2125] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:32:26.268954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:26.280806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c139a4-3f24-48c6-b456-4b1ed7094c88 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:26.287815 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:26.288420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:26.288697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:26.288968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:26.297704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:26.299306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:26.309179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1056/2126] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:30.426856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585807-c764-4e28-b8ec-281ef0c4d55d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:30.427345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585807-c764-4e28-b8ec-281ef0c4d55d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:30.427462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55585807-c764-4e28-b8ec-281ef0c4d55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:30.449830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-55585807-c764-4e28-b8ec-281ef0c4d55d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:32:30.451052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-55585807-c764-4e28-b8ec-281ef0c4d55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:30.459768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1071/2127] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:32:30.482718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:30.493718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736df139-59c0-4fb2-8773-896dd5df8d67 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:30.499509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:30.500121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:30.500655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:30.500902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:30.510666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:30.512300 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:30.522705 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1057/2128] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:34.642149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6116-5868-4e6e-96c8-5238eaffaa1d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:34.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6116-5868-4e6e-96c8-5238eaffaa1d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:34.642692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6116-5868-4e6e-96c8-5238eaffaa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:34.663258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c81d6116-5868-4e6e-96c8-5238eaffaa1d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:32:34.664459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c81d6116-5868-4e6e-96c8-5238eaffaa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:34.673094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1072/2129] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 11 13:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:32:34.687640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:34.699184 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4916a6-d65e-43be-a7e1-d2f1be0ef1e3 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:34.706380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:34.707295 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:34.707567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:34.707848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:34.717810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:34.719514 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:34.729157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1058/2130] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:37.930521 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d6116-5868-4e6e-96c8-5238eaffaa1d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:37.946535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d6116-5868-4e6e-96c8-5238eaffaa1d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:37.955284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:37.955929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:37.956207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:37.956476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:37.958514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:38.021588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:38.023233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:38.032699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1073/2131] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:38.050864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:38.055352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=62 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:38.061450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c8499-f44e-4047-b469-7750945b3edc service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:38.065733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:38.066436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:38.066779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:38.067172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:38.069025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:38.079364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:38.080917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:38.089339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1059/2132] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:32:46.892830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:46.899496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=70 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:46.909304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4923c45-59c2-4383-b874-c03fc3938cb0 service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:46.916215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:46.916903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:46.917186 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:46.917597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:46.920952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:46.935375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:46.936968 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:46.947835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1074/2133] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:48.085910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:49.704723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:49.715330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930568-bfb0-4047-9d4f-c394f9ce6814 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:49.719887 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:49.720526 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:49.720835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:49.721227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:49.723092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:49.737508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:49.739761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:49.758133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1060/2134] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:32:50.024933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:50.026612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:50.041658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0631b-723e-4a4e-a65a-36e9b8c1e416 service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:50.051119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b102b6-8e7e-4b70-bc02-d17994fef41e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:50.051944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b102b6-8e7e-4b70-bc02-d17994fef41e service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:50.052409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b102b6-8e7e-4b70-bc02-d17994fef41e service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:50.052860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b102b6-8e7e-4b70-bc02-d17994fef41e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:50.055199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a5b102b6-8e7e-4b70-bc02-d17994fef41e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:50.067647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b102b6-8e7e-4b70-bc02-d17994fef41e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:50.069356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b102b6-8e7e-4b70-bc02-d17994fef41e service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:50.079696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1075/2135] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:32:53.074322 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:32:53.093999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23bf10-748c-49f0-889e-a92fe7adbea6 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:32:53.100046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:32:53.100700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:32:53.101008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:32:53.101263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:32:53.103174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:32:53.165782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:32:53.167422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:32:53.177136 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1061/2136] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:32:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:00.075481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=11 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:03.172702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=34 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:05.006046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:05.006625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:05.006625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:05.026409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] MFA Rules not processed for user `532592384a174f4aade6ab3565fd32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:05.027699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:05.035966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1076/2137] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:05.358569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:05.369016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f5913-6e3e-4957-aa72-0281b6310014 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:05.373572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:05.374220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:05.374497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:05.374762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:05.377071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:05.387713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:05.389159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:05.397516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1062/2138] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:08.572326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:08.574693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:08.593916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4704a4-3981-42d0-a9d6-d85e50e24b12 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:08.598772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:08.599478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:08.599753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:08.600096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] PATH_INFO: `/v3/users/8155e14c4b30424da62aa5fcb6e86a1d` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:08.601196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8155e14c4b30424da62aa5fcb6e86a1d)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:08.610166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:08.611203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:08.625254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c980527-87b4-4071-b549-6ca422ae9c63 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:08.631355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:08.632316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:08.632829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:08.633246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:08.635361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:08.648414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:08.650137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:08.662109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1063/2139] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:33:08.682594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8155e14c4b30424da62aa5fcb6e86a1d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:08.691107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8155e14c4b30424da62aa5fcb6e86a1d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:08.691957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8155e14c4b30424da62aa5fcb6e86a1d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:08.692740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8155e14c4b30424da62aa5fcb6e86a1d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:08.702290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8155e14c4b30424da62aa5fcb6e86a1d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:08.721177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1077/2140] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:33:08 2022] DELETE /identity/v3/users/8155e14c4b30424da62aa5fcb6e86a1d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:08.892169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:08.904857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57607-bcbc-443d-a920-be419959eee6 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:08.967444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:08.968185 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:08.968461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:08.968753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] PATH_INFO: `/v3/projects/e6ec95568a944568b3bfdbb325ee8af8` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:08.969882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ec95568a944568b3bfdbb325ee8af8)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:08.971826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:09.023249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ec95568a944568b3bfdbb325ee8af8', 'request_id': 'req-79b61907-a08d-47c5-bf01-44ceda255f86'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:09.033288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ec95568a944568b3bfdbb325ee8af8', 'request_id': 'req-79b61907-a08d-47c5-bf01-44ceda255f86'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:09.040567 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ec95568a944568b3bfdbb325ee8af8', 'request_id': 'req-79b61907-a08d-47c5-bf01-44ceda255f86'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:09.053475 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] The token cache is being invalidate because project e6ec95568a944568b3bfdbb325ee8af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:33:09.053774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:09.054566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:09.056496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1064/2141] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:33:08 2022] DELETE /identity/v3/projects/e6ec95568a944568b3bfdbb325ee8af8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:13.760684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:13.762241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:13.843165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec878-8711-4ec4-ab43-59473fa3896c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:13.902512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:13.911949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:13.912580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:13.912861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:13.913142 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:13.915372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:13.928468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:13.930098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:13.940677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1078/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:19.050239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:21.482175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:21.485087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:21.552198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b61907-a08d-47c5-bf01-44ceda255f86 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:21.556170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:21.556782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:21.557060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:21.557320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:21.560160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:21.619598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:21.620961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:21.630005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1065/2143] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:23.936669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:31.626229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=48 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:40.571865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:40.573436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:40.633462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a873157-cecd-4205-bd77-053f487fb983 service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:40.637719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:40.638326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:40.638606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:40.638900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:40.640777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:40.713007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:40.714528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:40.726049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1079/2144] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:43.998552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.000191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:44.015724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171340ff-c8d0-4031-a1d6-5dc35509b658 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.020596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.021254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.021508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.021775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] PATH_INFO: `/v3/users/18ae891c0f6742caaa94c3673f03628c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.023012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ae891c0f6742caaa94c3673f03628c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.025069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.072776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ae891c0f6742caaa94c3673f03628c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.079414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ae891c0f6742caaa94c3673f03628c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.080122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ae891c0f6742caaa94c3673f03628c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.080747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ae891c0f6742caaa94c3673f03628c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.089358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c155fb50-db22-4f59-b176-4374100bddcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ae891c0f6742caaa94c3673f03628c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.107737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1066/2145] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:33:43 2022] DELETE /identity/v3/users/18ae891c0f6742caaa94c3673f03628c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:44.289587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.301060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee1be-8639-49d3-8c7b-c16ea5b549a3 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.363832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.364477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.364754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.365027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] PATH_INFO: `/v3/projects/491c8d17e84149eea4d71675631f52d5` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.366163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491c8d17e84149eea4d71675631f52d5)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.368847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.429120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491c8d17e84149eea4d71675631f52d5', 'request_id': 'req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.431922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:44.438773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491c8d17e84149eea4d71675631f52d5', 'request_id': 'req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.446320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491c8d17e84149eea4d71675631f52d5', 'request_id': 'req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.457677 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] The token cache is being invalidate because project 491c8d17e84149eea4d71675631f52d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:33:44.457964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.458669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-3351ae35-6702-4ea5-a683-8a5b9f9f1dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:44.460243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1080/2146] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:33:44 2022] DELETE /identity/v3/projects/491c8d17e84149eea4d71675631f52d5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:44.465523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a8629-67d1-4e40-8862-e6b3cebd84df None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.465811 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a8629-67d1-4e40-8862-e6b3cebd84df None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.466088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a8629-67d1-4e40-8862-e6b3cebd84df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.486755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-7f3a8629-67d1-4e40-8862-e6b3cebd84df None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:44.488000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7f3a8629-67d1-4e40-8862-e6b3cebd84df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:44.552095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1067/2147] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:44.560335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada27ef-208d-4b92-a09d-0becb48d0fb8 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.560624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada27ef-208d-4b92-a09d-0becb48d0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.560919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada27ef-208d-4b92-a09d-0becb48d0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.582280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1ada27ef-208d-4b92-a09d-0becb48d0fb8 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:44.583528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1ada27ef-208d-4b92-a09d-0becb48d0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:44.592229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1081/2148] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:44.596590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a8629-67d1-4e40-8862-e6b3cebd84df None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.607620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a8629-67d1-4e40-8862-e6b3cebd84df None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.612458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.613225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.613364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.613588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.614570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:33:44.614715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.616305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.629218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1068/2149] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:33:44.633728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada27ef-208d-4b92-a09d-0becb48d0fb8 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.643680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada27ef-208d-4b92-a09d-0becb48d0fb8 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.648845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.649469 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.649748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.650057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.650792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.652832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.682705 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1082/2150] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:33:44 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:33:44.687077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.697231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf01c5-0ac1-4f43-9522-95e329873f91 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.764971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.765601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.765877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.766153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.766849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.768803 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.777158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:44.792081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1069/2151] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:33:44 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:33:44.796554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.808136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dfd1e-57de-4863-adb8-2e89ca28214c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.813266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.813921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.814197 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.814464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.815159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.816812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.827491 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1083/2152] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:44.831676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.842355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2923d-36cf-47b7-8da7-e256bdfd368c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.847372 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25248b20-08b9-4229-aa10-c4289ec5df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.847965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248b20-08b9-4229-aa10-c4289ec5df62 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.848245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248b20-08b9-4229-aa10-c4289ec5df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.848509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248b20-08b9-4229-aa10-c4289ec5df62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.849151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25248b20-08b9-4229-aa10-c4289ec5df62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.850779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25248b20-08b9-4229-aa10-c4289ec5df62 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.861723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1070/2153] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:44.866132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:44.877275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f76b3-c6c0-47bb-856f-81fc42afa319 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:44.882790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:44.883541 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.883817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.884089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] PATH_INFO: `/v3/projects/2fe2358ed7454c4a88851feb80279c2f/users/805a892db28142f8a71887e22ed76ff3/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.900164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe2358ed7454c4a88851feb80279c2f, user_id=805a892db28142f8a71887e22ed76ff3, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:44.902849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:44.918329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1084/2154] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:33:44 2022] PUT /identity/v3/projects/2fe2358ed7454c4a88851feb80279c2f/users/805a892db28142f8a71887e22ed76ff3/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:44.934219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad322b9-6936-4a14-ad00-87aebc00bed5 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:44.934510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad322b9-6936-4a14-ad00-87aebc00bed5 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:44.934779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad322b9-6936-4a14-ad00-87aebc00bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:44.964151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-bad322b9-6936-4a14-ad00-87aebc00bed5 None None] MFA Rules not processed for user `805a892db28142f8a71887e22ed76ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:44.965364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bad322b9-6936-4a14-ad00-87aebc00bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:45.029932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1071/2155] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:45.043559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:45.045520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:45.127951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d40cec-0a5a-4ae7-9ff9-c2f909704231 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:45.134346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f5263-07f4-418f-ab60-8f21c93ac0ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:45.135004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5263-07f4-418f-ab60-8f21c93ac0ff service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:45.135281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5263-07f4-418f-ab60-8f21c93ac0ff service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:45.135534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5263-07f4-418f-ab60-8f21c93ac0ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:45.143685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f5263-07f4-418f-ab60-8f21c93ac0ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:45.145289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f5263-07f4-418f-ab60-8f21c93ac0ff service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:45.154253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1085/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:50.731244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad322b9-6936-4a14-ad00-87aebc00bed5 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:50.792836 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad322b9-6936-4a14-ad00-87aebc00bed5 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:50.797774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:50.798414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:50.798694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:50.798998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] PATH_INFO: `/v3/users/805a892db28142f8a71887e22ed76ff3` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:50.800133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805a892db28142f8a71887e22ed76ff3)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:50.802061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:50.853968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805a892db28142f8a71887e22ed76ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:50.861346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805a892db28142f8a71887e22ed76ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:50.862090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805a892db28142f8a71887e22ed76ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:50.862729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805a892db28142f8a71887e22ed76ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:50.871921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805a892db28142f8a71887e22ed76ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:50.877578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:50.892504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1072/2157] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:33:50 2022] DELETE /identity/v3/users/805a892db28142f8a71887e22ed76ff3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:50.897246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:50.897730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:50.897825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:50.917299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:50.918498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:50.980946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1086/2158] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:33:50.990873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:50.992334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:51.056401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6492da6-d59e-4dd4-be27-aec09905b5d1 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.060648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd30ad-dbdf-4542-8964-e533a085c51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.061271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd30ad-dbdf-4542-8964-e533a085c51a service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.061543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd30ad-dbdf-4542-8964-e533a085c51a service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.061812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd30ad-dbdf-4542-8964-e533a085c51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.071985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd30ad-dbdf-4542-8964-e533a085c51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.073586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd30ad-dbdf-4542-8964-e533a085c51a service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.083502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1073/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:51.406592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:51.408131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:51.415144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:51.421257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a70556-feea-4bd6-aa7d-1aff8897988d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.427553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.428215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.428499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.428772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] PATH_INFO: `/v3/projects/2fe2358ed7454c4a88851feb80279c2f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.430262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe2358ed7454c4a88851feb80279c2f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.433234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.486324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe2358ed7454c4a88851feb80279c2f', 'request_id': 'req-6fb4179f-63d3-43fc-89a1-7771ffe2e833'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:51.496050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe2358ed7454c4a88851feb80279c2f', 'request_id': 'req-6fb4179f-63d3-43fc-89a1-7771ffe2e833'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:51.503870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe2358ed7454c4a88851feb80279c2f', 'request_id': 'req-6fb4179f-63d3-43fc-89a1-7771ffe2e833'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:51.515301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] The token cache is being invalidate because project 2fe2358ed7454c4a88851feb80279c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:33:51.515589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:51.516258 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-6fb4179f-63d3-43fc-89a1-7771ffe2e833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:51.517815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1087/2160] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:33:51 2022] DELETE /identity/v3/projects/2fe2358ed7454c4a88851feb80279c2f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:51.523949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed97c4-ffb0-4b9d-9074-9e497e2919d4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.524275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed97c4-ffb0-4b9d-9074-9e497e2919d4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.524545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed97c4-ffb0-4b9d-9074-9e497e2919d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.545351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8bed97c4-ffb0-4b9d-9074-9e497e2919d4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:51.546774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8bed97c4-ffb0-4b9d-9074-9e497e2919d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:51.611863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1074/2161] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:51.620198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5b2bc-69a0-4a24-ba2c-219ff1bf76b6 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.620508 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5b2bc-69a0-4a24-ba2c-219ff1bf76b6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.620805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5b2bc-69a0-4a24-ba2c-219ff1bf76b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.641606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-4cd5b2bc-69a0-4a24-ba2c-219ff1bf76b6 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:51.642744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4cd5b2bc-69a0-4a24-ba2c-219ff1bf76b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:51.651373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1088/2162] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:51.655973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed97c4-ffb0-4b9d-9074-9e497e2919d4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:51.666544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed97c4-ffb0-4b9d-9074-9e497e2919d4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.673040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.673660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.673932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.674604 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.674934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:33:51.675238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.677804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.692236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1075/2163] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:33:51.696753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5b2bc-69a0-4a24-ba2c-219ff1bf76b6 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:51.708394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5b2bc-69a0-4a24-ba2c-219ff1bf76b6 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.713801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.714427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.714692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.714992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.715633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.717542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.756459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1089/2164] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:33:51 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:33:51.757956 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:51.769539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1f90a-6bd6-4e8f-ace1-04da4adce51e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.827874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.828479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.828751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.829021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.829694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.831644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.859595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1076/2165] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:33:51 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:33:51.861556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:51.873218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bb6e7-e87e-4119-853f-7e577bd1886d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.878227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.878891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.879168 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.879432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.880090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.881695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.892728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1090/2166] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:51.896829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:51.907825 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a248-e816-42f3-a048-8fc285f9033f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.913086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ff56-3990-4b72-9adc-88f71ef7166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.913737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ff56-3990-4b72-9adc-88f71ef7166c admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.914010 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ff56-3990-4b72-9adc-88f71ef7166c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.914277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ff56-3990-4b72-9adc-88f71ef7166c admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.914967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1ff56-3990-4b72-9adc-88f71ef7166c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.916616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1ff56-3990-4b72-9adc-88f71ef7166c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.918028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:51.928619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1077/2167] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:51.932813 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:51.943212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55735abd-3572-4b06-bbac-963be013a4c2 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:51.948008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:51.948684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.949374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.949374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] PATH_INFO: `/v3/projects/34e7bf8a284347108ab9b737ef2b765f/users/f46ce58e30b54009a57fa53527aa8f02/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:51.964598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e7bf8a284347108ab9b737ef2b765f, user_id=f46ce58e30b54009a57fa53527aa8f02, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:51.967285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:51.980848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1091/2168] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:33:51 2022] PUT /identity/v3/projects/34e7bf8a284347108ab9b737ef2b765f/users/f46ce58e30b54009a57fa53527aa8f02/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:51.991601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c24c5-6bed-47fc-8fa2-e79969ca4ead None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:51.991883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c24c5-6bed-47fc-8fa2-e79969ca4ead None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:51.992156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c24c5-6bed-47fc-8fa2-e79969ca4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.020302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5e4c24c5-6bed-47fc-8fa2-e79969ca4ead None None] MFA Rules not processed for user `f46ce58e30b54009a57fa53527aa8f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:52.021515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5e4c24c5-6bed-47fc-8fa2-e79969ca4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:52.087781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1078/2169] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:52.092462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.156266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d22cf-5824-4c81-9e47-b3cc34374b9e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.160891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.161632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.161907 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.162181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.162803 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.164761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.193103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1092/2170] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:33:52 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:33:52.197367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c24c5-6bed-47fc-8fa2-e79969ca4ead None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.208878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c24c5-6bed-47fc-8fa2-e79969ca4ead None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.264783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.265489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.265760 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.266030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.266663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.268605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.294859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1079/2171] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:33:52 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:33:52.299161 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.310351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf3dd1-1959-4c25-9e30-ada6e637e5b4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.316104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.316746 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.317025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.317294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.317944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.319622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.326056 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:52.331769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1093/2172] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:52.336363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.349080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51950df2-a3fd-4e6c-9a36-593cccf3ae65 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.354152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.355004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.355308 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.355581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] PATH_INFO: `/v3/projects/b2fff6db59084f75bb664534a12189db/users/6177e6be12a54dcfb12cfe259c1e0d55/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.372692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fff6db59084f75bb664534a12189db, user_id=6177e6be12a54dcfb12cfe259c1e0d55, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.375417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.390413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1080/2173] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:33:52 2022] PUT /identity/v3/projects/b2fff6db59084f75bb664534a12189db/users/6177e6be12a54dcfb12cfe259c1e0d55/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:33:52.394742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.405648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c98c-41b5-4d65-b6b3-c2dc633447a0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.471331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa76112-787a-4c53-a883-64177464f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.472143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76112-787a-4c53-a883-64177464f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.472398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76112-787a-4c53-a883-64177464f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.472661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76112-787a-4c53-a883-64177464f0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.473326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa76112-787a-4c53-a883-64177464f0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.475007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa76112-787a-4c53-a883-64177464f0b3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.485592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1094/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:52.489976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.501066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132402d-fb83-4aab-b220-85279639550a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.505945 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.506607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.506921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.507198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] PATH_INFO: `/v3/projects/b2fff6db59084f75bb664534a12189db/users/6177e6be12a54dcfb12cfe259c1e0d55/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.509376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fff6db59084f75bb664534a12189db, user_id=6177e6be12a54dcfb12cfe259c1e0d55, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.512621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.523911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1081/2175] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:33:52 2022] PUT /identity/v3/projects/b2fff6db59084f75bb664534a12189db/users/6177e6be12a54dcfb12cfe259c1e0d55/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:33:52.535891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847aadf-02a0-4269-a2f5-b6043e21261e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.536134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847aadf-02a0-4269-a2f5-b6043e21261e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.536426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847aadf-02a0-4269-a2f5-b6043e21261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.567017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6847aadf-02a0-4269-a2f5-b6043e21261e None None] MFA Rules not processed for user `6177e6be12a54dcfb12cfe259c1e0d55`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:52.568461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6847aadf-02a0-4269-a2f5-b6043e21261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:52.643456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1095/2176] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:52.656039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.658847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:52.694739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ecef-9508-4bd8-9776-6650a5d7c536 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.695082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ecef-9508-4bd8-9776-6650a5d7c536 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.695357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ecef-9508-4bd8-9776-6650a5d7c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.705377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:52.715515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-4004ecef-9508-4bd8-9776-6650a5d7c536 None None] MFA Rules not processed for user `4ac6d0fcbeb7496db5bb873d99e1c20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:52.716720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4004ecef-9508-4bd8-9776-6650a5d7c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:52.722283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534a85-f955-442f-9872-f8bb08e969ef admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.726003 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.726617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.726920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.727196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.737068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.738485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.748546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1082/2177] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:52.775036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1096/2178] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:52.794047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:52.795689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:52.808433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79175f-e65e-4dcc-adef-82c73ad84212 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:52.812632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c33d0c-5eac-43ce-b6fe-7882678f1510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:52.813261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c33d0c-5eac-43ce-b6fe-7882678f1510 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:52.813540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c33d0c-5eac-43ce-b6fe-7882678f1510 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:52.813799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c33d0c-5eac-43ce-b6fe-7882678f1510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:52.873284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c33d0c-5eac-43ce-b6fe-7882678f1510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:52.874754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c33d0c-5eac-43ce-b6fe-7882678f1510 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:52.884511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1083/2179] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:56.327156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004ecef-9508-4bd8-9776-6650a5d7c536 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:56.353545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:56.391728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004ecef-9508-4bd8-9776-6650a5d7c536 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:56.396741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:56.397378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:56.397658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:56.397921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] PATH_INFO: `/v3/users/f46ce58e30b54009a57fa53527aa8f02` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:56.399099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46ce58e30b54009a57fa53527aa8f02)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:56.401136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:56.450420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46ce58e30b54009a57fa53527aa8f02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:56.457020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46ce58e30b54009a57fa53527aa8f02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:56.457665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46ce58e30b54009a57fa53527aa8f02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:56.458250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46ce58e30b54009a57fa53527aa8f02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:56.467020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46ce58e30b54009a57fa53527aa8f02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:56.484462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1097/2180] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:33:56 2022] DELETE /identity/v3/users/f46ce58e30b54009a57fa53527aa8f02 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:56.489551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:56.490058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:56.490169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:56.512615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:56.513826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:56.583458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1084/2181] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:33:56.593465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:56.595024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:56.655382 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7cecb-ed67-4917-9877-66765d2a905a admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:56.659807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:56.660415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:56.660693 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:56.660965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:56.671688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:56.673489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:56.683577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1098/2182] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:56.956080 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:56.957674 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:56.971778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5999fa-da63-4398-8e58-684730f62392 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:56.976829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:56.977543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:56.977854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:56.978122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] PATH_INFO: `/v3/projects/34e7bf8a284347108ab9b737ef2b765f` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:56.979314 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e7bf8a284347108ab9b737ef2b765f)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:56.981241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:57.029614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e7bf8a284347108ab9b737ef2b765f', 'request_id': 'req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.039277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e7bf8a284347108ab9b737ef2b765f', 'request_id': 'req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.045874 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e7bf8a284347108ab9b737ef2b765f', 'request_id': 'req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.056689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] The token cache is being invalidate because project 34e7bf8a284347108ab9b737ef2b765f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:33:57.056971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.057605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.059261 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1085/2183] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:33:56 2022] DELETE /identity/v3/projects/34e7bf8a284347108ab9b737ef2b765f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:57.063650 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:57.073617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2930a4-1c1f-417a-8055-5a315f7e1b06 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:57.117007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:57.133797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:57.134440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:57.134719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:57.135018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] PATH_INFO: `/v3/users/6177e6be12a54dcfb12cfe259c1e0d55` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:57.136163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6177e6be12a54dcfb12cfe259c1e0d55)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:57.138100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:57.187867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6177e6be12a54dcfb12cfe259c1e0d55'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.195025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6177e6be12a54dcfb12cfe259c1e0d55'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.195729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6177e6be12a54dcfb12cfe259c1e0d55'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.196344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6177e6be12a54dcfb12cfe259c1e0d55'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.205861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9d31f167-c012-4bbe-98e7-19ed30111261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6177e6be12a54dcfb12cfe259c1e0d55'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.222658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1099/2184] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:33:57 2022] DELETE /identity/v3/users/6177e6be12a54dcfb12cfe259c1e0d55 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:57.509321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:57.511058 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:57.521154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:57.528579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c836-b0d6-47f0-8b5d-7d5e3e828c65 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:57.590064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:57.590620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:57.590918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:57.591213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] PATH_INFO: `/v3/projects/b2fff6db59084f75bb664534a12189db` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:57.592389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fff6db59084f75bb664534a12189db)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:57.594313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:57.652883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fff6db59084f75bb664534a12189db', 'request_id': 'req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.662577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fff6db59084f75bb664534a12189db', 'request_id': 'req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.671247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fff6db59084f75bb664534a12189db', 'request_id': 'req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.681971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] The token cache is being invalidate because project b2fff6db59084f75bb664534a12189db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:33:57.682251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.682932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-ac6d74b8-1b44-4a8f-b713-2558c5d981e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:33:57.684660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1086/2185] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:33:57 2022] DELETE /identity/v3/projects/b2fff6db59084f75bb664534a12189db => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:57.690675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b873-fd1f-4c70-817b-6f229a9b061e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:57.691201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b873-fd1f-4c70-817b-6f229a9b061e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:57.691299 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b873-fd1f-4c70-817b-6f229a9b061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:57.711745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a455b873-fd1f-4c70-817b-6f229a9b061e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:57.712934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a455b873-fd1f-4c70-817b-6f229a9b061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:57.775957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1100/2186] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:57.785345 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a845-db13-4e65-8e1e-88138fc8a7d6 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:57.785630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a845-db13-4e65-8e1e-88138fc8a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:57.785967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a845-db13-4e65-8e1e-88138fc8a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:57.811275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8e38a845-db13-4e65-8e1e-88138fc8a7d6 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:57.812499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8e38a845-db13-4e65-8e1e-88138fc8a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:57.821642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1087/2187] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:57.825971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b873-fd1f-4c70-817b-6f229a9b061e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:57.836097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b873-fd1f-4c70-817b-6f229a9b061e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:57.841673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:57.842193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:57.842493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:57.842765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:57.843445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:33:57.843744 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:57.845351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:57.857101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1101/2188] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:33:57.861696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a845-db13-4e65-8e1e-88138fc8a7d6 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:57.871554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a845-db13-4e65-8e1e-88138fc8a7d6 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:57.877702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:57.878304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:57.878582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:57.878929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:57.879479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:57.881421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:57.913025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1088/2189] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:33:57 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:33:57.917331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:57.928176 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27783ee-691a-4272-93df-9b46b992fe3d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:57.980625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:57.992826 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:57.993457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:57.993789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:57.994492 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:57.995252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:57.997234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:58.021531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1102/2190] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:33:57 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:33:58.025552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:58.037116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7786e7-0ced-4f57-a572-1b4bd8ea2b9e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:58.042727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:58.043384 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:58.043679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:58.043930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:58.044582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:58.046455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:58.057690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1089/2191] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:58.062055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:58.072317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349305-ae6e-4076-b3cc-846124a54a3f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:58.077352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226372-a017-45bc-afb4-c974a4489e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:58.077943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226372-a017-45bc-afb4-c974a4489e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:58.078218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226372-a017-45bc-afb4-c974a4489e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:58.078486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226372-a017-45bc-afb4-c974a4489e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:58.079643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226372-a017-45bc-afb4-c974a4489e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:58.080954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226372-a017-45bc-afb4-c974a4489e83 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:58.091324 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1103/2192] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:33:58.095647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:58.105569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042fcd0-1c6b-4241-bd0d-c2663b801ce7 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:58.110361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:58.111056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:58.111333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:58.111603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] PATH_INFO: `/v3/projects/213b9de76c494f259a65a6211ffefbc0/users/429ccf5afb114f2c9c63d80b0a98d6af/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:58.129342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213b9de76c494f259a65a6211ffefbc0, user_id=429ccf5afb114f2c9c63d80b0a98d6af, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:58.132066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:58.147307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1090/2193] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:33:58 2022] PUT /identity/v3/projects/213b9de76c494f259a65a6211ffefbc0/users/429ccf5afb114f2c9c63d80b0a98d6af/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:33:58.157849 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e60868-a232-49a1-98a0-168e6c8042d3 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:58.158165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e60868-a232-49a1-98a0-168e6c8042d3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:58.158436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e60868-a232-49a1-98a0-168e6c8042d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:58.188102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a5e60868-a232-49a1-98a0-168e6c8042d3 None None] MFA Rules not processed for user `429ccf5afb114f2c9c63d80b0a98d6af`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:33:58.189317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a5e60868-a232-49a1-98a0-168e6c8042d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:58.253952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1104/2194] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:33:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:33:58.266351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:33:58.268511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:33:58.302117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:58.330153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff0d9-f460-43c1-a599-c84cb8235535 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:33:58.334167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:33:58.334787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:33:58.335097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:33:58.335381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:33:58.344685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:33:58.346289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:33:58.355425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1091/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:33:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:08.251095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:08.351212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=13 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:18.001942 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:18.002377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:18.002688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:18.021954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:18.023167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:18.081648 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1105/2196] 10.222.0.16 () {58 vars in 967 bytes} [Tue Oct 11 13:34:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:34:18.130443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:18.131852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:18.201463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac6f60-bb7a-4701-b63a-604111493690 service glance] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:18.206766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:18.207478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:18.207757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:18.208050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:18.216545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:18.218264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:18.226990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1092/2197] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:34:21.521518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:21.523030 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:21.606304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e2fb9-176c-4103-8ee9-452b93fa7c1d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:21.611962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:21.612697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:21.612977 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:21.613256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:21.615146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:21.628454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:21.630064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:21.652833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1106/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:25.043866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.056260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b845238-b241-4c77-869a-7910459ce818 service swift] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:25.062371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:25.063083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.063420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.063757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.065801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:25.077885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:25.079729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:25.091296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1093/2199] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:25.107536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.109251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:25.177916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de17dd8-b783-464a-be4c-c78fbc97cc1a service placement] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:25.183148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:25.183839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.184112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.184379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] PATH_INFO: `/v3/users/cefda31dec244f9eb150decabc7d2a29` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.185519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefda31dec244f9eb150decabc7d2a29)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:25.187467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:25.229502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:25.238631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefda31dec244f9eb150decabc7d2a29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.245336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefda31dec244f9eb150decabc7d2a29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.246011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefda31dec244f9eb150decabc7d2a29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.246696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefda31dec244f9eb150decabc7d2a29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.255124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefda31dec244f9eb150decabc7d2a29'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.273587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1107/2200] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:34:25 2022] DELETE /identity/v3/users/cefda31dec244f9eb150decabc7d2a29 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:25.355856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.366611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0793-ced3-4234-9a7f-87b1420775d7 service placement] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:25.422148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:25.422777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.423417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.423685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] PATH_INFO: `/v3/users/429ccf5afb114f2c9c63d80b0a98d6af` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.424911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429ccf5afb114f2c9c63d80b0a98d6af)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:25.426843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:25.452837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.454376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:25.468239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf74c-6186-408c-b0c0-3e8383942b28 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:25.473254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:25.473963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.474413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.474797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] PATH_INFO: `/v3/projects/0aeb31f2ac384c42bca1e3084475b851` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.476046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aeb31f2ac384c42bca1e3084475b851)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:25.478091 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:25.484233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429ccf5afb114f2c9c63d80b0a98d6af'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.493308 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429ccf5afb114f2c9c63d80b0a98d6af'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.494059 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429ccf5afb114f2c9c63d80b0a98d6af'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.494657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429ccf5afb114f2c9c63d80b0a98d6af'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.503094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-92e0af61-106f-4452-8249-05f6dd45a720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429ccf5afb114f2c9c63d80b0a98d6af'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.514614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:25.522440 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1094/2201] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:34:25 2022] DELETE /identity/v3/users/429ccf5afb114f2c9c63d80b0a98d6af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:25.526853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.527217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.527839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.528764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aeb31f2ac384c42bca1e3084475b851', 'request_id': 'req-cf897531-a5d4-4e18-8c56-07c453887a77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.537120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aeb31f2ac384c42bca1e3084475b851', 'request_id': 'req-cf897531-a5d4-4e18-8c56-07c453887a77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.543953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aeb31f2ac384c42bca1e3084475b851', 'request_id': 'req-cf897531-a5d4-4e18-8c56-07c453887a77'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.549139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:25.550359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:25.554625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] The token cache is being invalidate because project 0aeb31f2ac384c42bca1e3084475b851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:34:25.554943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.555593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.557504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1108/2202] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:34:25 2022] DELETE /identity/v3/projects/0aeb31f2ac384c42bca1e3084475b851 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:34:25.561456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.562765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:25.609278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1095/2203] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:34:25.619598 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.620952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:25.627499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf897531-a5d4-4e18-8c56-07c453887a77 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:25.632193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:25.632828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.633155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.633449 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] PATH_INFO: `/v3/users/e5f5b31151a64889947638e271ed2c15` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.634580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f5b31151a64889947638e271ed2c15)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:25.636549 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:25.677872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28f07-a780-4d19-8acc-4e7d313f92d6 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:25.678657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:25.681847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:25.682484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.682758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.683054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.685450 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f5b31151a64889947638e271ed2c15'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.693200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:25.694135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f5b31151a64889947638e271ed2c15'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.694724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:25.694885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f5b31151a64889947638e271ed2c15'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.695484 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f5b31151a64889947638e271ed2c15'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.703723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f5b31151a64889947638e271ed2c15'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:25.705145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1096/2204] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:34:25.721812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1109/2205] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:34:25 2022] DELETE /identity/v3/users/e5f5b31151a64889947638e271ed2c15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:34:25.897195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.908871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fab3dc-d8f3-4277-b73e-a5e9f4b41fac service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:25.982682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:25.982895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:25.983523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:25.983801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:25.984078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] PATH_INFO: `/v3/projects/30a282f7ad8d4b8a93a9e43d98150ead` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:25.984372 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:25.985218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a282f7ad8d4b8a93a9e43d98150ead)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:25.987167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.010066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593ecf-bd31-42c1-b370-b0d82a56ff2b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.014982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.015622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.015921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.016189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] PATH_INFO: `/v3/projects/213b9de76c494f259a65a6211ffefbc0` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.017385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=213b9de76c494f259a65a6211ffefbc0)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.019327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.032348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:26.039877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a282f7ad8d4b8a93a9e43d98150ead', 'request_id': 'req-fd39c290-d513-4a61-b7fd-851a4825be15'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.048611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a282f7ad8d4b8a93a9e43d98150ead', 'request_id': 'req-fd39c290-d513-4a61-b7fd-851a4825be15'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.055399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a282f7ad8d4b8a93a9e43d98150ead', 'request_id': 'req-fd39c290-d513-4a61-b7fd-851a4825be15'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.066348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] The token cache is being invalidate because project 30a282f7ad8d4b8a93a9e43d98150ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:34:26.066638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.066835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213b9de76c494f259a65a6211ffefbc0', 'request_id': 'req-4090f56a-70fe-4181-aa14-d3beec812eda'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.067307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-fd39c290-d513-4a61-b7fd-851a4825be15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.068820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1097/2206] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:34:25 2022] DELETE /identity/v3/projects/30a282f7ad8d4b8a93a9e43d98150ead => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:34:26.075366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213b9de76c494f259a65a6211ffefbc0', 'request_id': 'req-4090f56a-70fe-4181-aa14-d3beec812eda'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.083098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213b9de76c494f259a65a6211ffefbc0', 'request_id': 'req-4090f56a-70fe-4181-aa14-d3beec812eda'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.095425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] The token cache is being invalidate because project 213b9de76c494f259a65a6211ffefbc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:34:26.095717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.096379 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-4090f56a-70fe-4181-aa14-d3beec812eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:26.097915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1110/2207] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:34:25 2022] DELETE /identity/v3/projects/213b9de76c494f259a65a6211ffefbc0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:26.102881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e8ca-94ff-4b0e-9386-c6362e4559cf None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.103161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e8ca-94ff-4b0e-9386-c6362e4559cf None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.103427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e8ca-94ff-4b0e-9386-c6362e4559cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.125752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b651e8ca-94ff-4b0e-9386-c6362e4559cf None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:26.127019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b651e8ca-94ff-4b0e-9386-c6362e4559cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:26.191941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1098/2208] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:34:26.201453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba766c-aeb4-431b-b1d4-00585de4f3ff None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.201991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba766c-aeb4-431b-b1d4-00585de4f3ff None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.201991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba766c-aeb4-431b-b1d4-00585de4f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.223763 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-10ba766c-aeb4-431b-b1d4-00585de4f3ff None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:26.224990 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-10ba766c-aeb4-431b-b1d4-00585de4f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:26.233527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1111/2209] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:34:26.237830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e8ca-94ff-4b0e-9386-c6362e4559cf None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:26.248492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e8ca-94ff-4b0e-9386-c6362e4559cf None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.253511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.254141 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.254420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.254692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.255396 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:34:26.255729 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.257383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.271931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1099/2210] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:34:26.276545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba766c-aeb4-431b-b1d4-00585de4f3ff None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:26.286868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba766c-aeb4-431b-b1d4-00585de4f3ff None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.292578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.293361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.293607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.293901 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.294534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.296510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.329212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1112/2211] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:34:26 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:34:26.333607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:26.344742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7e52e-fbdd-4e13-806a-76e59f30c003 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.402298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.403065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.403342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.403608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.404232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.406214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.428143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1100/2212] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:34:26 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:34:26.432575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:26.443553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7e82-2c7c-4706-9365-a59313618253 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.449283 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.449948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.450227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.450494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.451174 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.452781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.463409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1113/2213] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:34:26.467785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:26.478064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f203ad-13a3-4089-b9b1-eea30de776a2 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.483166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c9da-aec0-4437-99d6-78526ecc6325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.483763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c9da-aec0-4437-99d6-78526ecc6325 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.484076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c9da-aec0-4437-99d6-78526ecc6325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.484346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c9da-aec0-4437-99d6-78526ecc6325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.484985 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c9da-aec0-4437-99d6-78526ecc6325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.486554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c9da-aec0-4437-99d6-78526ecc6325 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.497306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1101/2214] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:34:26.501565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:26.512698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3665-4b53-4f75-a9b4-539da8a05f17 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.518850 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.519535 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.519812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.520082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] PATH_INFO: `/v3/projects/cf1ac17ac51d4cf2ab05ed8104b5c67a/users/3b1149c3102243e7872b0d24ee3585ec/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.536091 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1ac17ac51d4cf2ab05ed8104b5c67a, user_id=3b1149c3102243e7872b0d24ee3585ec, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.538840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.553870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1114/2215] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:34:26 2022] PUT /identity/v3/projects/cf1ac17ac51d4cf2ab05ed8104b5c67a/users/3b1149c3102243e7872b0d24ee3585ec/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:26.564469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7183c-4d64-4bcb-857f-0eac43423d40 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.564829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7183c-4d64-4bcb-857f-0eac43423d40 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.565107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7183c-4d64-4bcb-857f-0eac43423d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.594674 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1ec7183c-4d64-4bcb-857f-0eac43423d40 None None] MFA Rules not processed for user `3b1149c3102243e7872b0d24ee3585ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:26.595918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1ec7183c-4d64-4bcb-857f-0eac43423d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:26.622230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:26.666400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1102/2216] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:34:26.678775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:26.681554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:26.728402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:26.747827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c921b-e08e-4222-9f3c-883d47fe62e4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:26.751716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78e5ef-97b5-4322-880b-4062cc6d3376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:26.752318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e5ef-97b5-4322-880b-4062cc6d3376 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:26.752589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e5ef-97b5-4322-880b-4062cc6d3376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:26.752853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e5ef-97b5-4322-880b-4062cc6d3376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:26.761210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78e5ef-97b5-4322-880b-4062cc6d3376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:26.762737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78e5ef-97b5-4322-880b-4062cc6d3376 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:26.771512 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1115/2217] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:36.663491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=16 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:36.767858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=10 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:37.174489 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7183c-4d64-4bcb-857f-0eac43423d40 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:37.242026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7183c-4d64-4bcb-857f-0eac43423d40 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:37.248269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:37.248900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:37.249174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:37.249470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] PATH_INFO: `/v3/users/3b1149c3102243e7872b0d24ee3585ec` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:37.250689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1149c3102243e7872b0d24ee3585ec)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:37.252649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:37.303677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1149c3102243e7872b0d24ee3585ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.310480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1149c3102243e7872b0d24ee3585ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.311129 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1149c3102243e7872b0d24ee3585ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.311722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1149c3102243e7872b0d24ee3585ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.321435 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1149c3102243e7872b0d24ee3585ec'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.341267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1103/2218] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:34:37 2022] DELETE /identity/v3/users/3b1149c3102243e7872b0d24ee3585ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:37.345817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:37.346092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:37.346359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:37.365815 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:37.367045 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:37.433576 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1116/2219] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:34:37.443462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:37.445017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:37.501992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5f0f8-8371-494e-a66c-47fa786fe225 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:37.505849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f49ec-f768-405a-97c4-010083c93cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:37.506447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f49ec-f768-405a-97c4-010083c93cea service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:37.506716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f49ec-f768-405a-97c4-010083c93cea service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:37.506996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f49ec-f768-405a-97c4-010083c93cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:37.516700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f49ec-f768-405a-97c4-010083c93cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:37.518153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f49ec-f768-405a-97c4-010083c93cea service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:37.528487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1104/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:37.826371 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:37.828046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:37.843216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe0251-7c76-490f-91f7-545e10b9eb6c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:37.847948 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:37.848588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:37.848867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:37.849136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] PATH_INFO: `/v3/projects/cf1ac17ac51d4cf2ab05ed8104b5c67a` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:37.850291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1ac17ac51d4cf2ab05ed8104b5c67a)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:37.852231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:37.902460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1ac17ac51d4cf2ab05ed8104b5c67a', 'request_id': 'req-fd9ebbeb-552a-4713-a61c-2fe666980339'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.911374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1ac17ac51d4cf2ab05ed8104b5c67a', 'request_id': 'req-fd9ebbeb-552a-4713-a61c-2fe666980339'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.918023 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1ac17ac51d4cf2ab05ed8104b5c67a', 'request_id': 'req-fd9ebbeb-552a-4713-a61c-2fe666980339'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.928974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] The token cache is being invalidate because project cf1ac17ac51d4cf2ab05ed8104b5c67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:34:37.929342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.930059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-fd9ebbeb-552a-4713-a61c-2fe666980339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:37.931703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1117/2221] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:34:37 2022] DELETE /identity/v3/projects/cf1ac17ac51d4cf2ab05ed8104b5c67a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:37.936841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3d34-db5c-4410-bafd-669dd2086918 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:37.937288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3d34-db5c-4410-bafd-669dd2086918 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:37.937392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3d34-db5c-4410-bafd-669dd2086918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:37.956734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-fa0a3d34-db5c-4410-bafd-669dd2086918 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:37.957917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fa0a3d34-db5c-4410-bafd-669dd2086918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:37.974720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:38.017327 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1105/2222] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:34:38.026501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d18fa-f797-4427-8ec5-2dd572e1a3d6 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.026786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d18fa-f797-4427-8ec5-2dd572e1a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.027089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d18fa-f797-4427-8ec5-2dd572e1a3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.049657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-567d18fa-f797-4427-8ec5-2dd572e1a3d6 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:38.050909 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-567d18fa-f797-4427-8ec5-2dd572e1a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:38.059895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1118/2223] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:34:38.064238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3d34-db5c-4410-bafd-669dd2086918 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:38.074172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3d34-db5c-4410-bafd-669dd2086918 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:38.079902 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:38.080504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.080773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.081035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.081673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:34:38.081986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:38.083596 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:38.095608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1106/2224] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:34:38.100236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d18fa-f797-4427-8ec5-2dd572e1a3d6 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:38.109662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d18fa-f797-4427-8ec5-2dd572e1a3d6 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:38.115256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:38.115947 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.116156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.116459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.117128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:38.119278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:38.149305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1119/2225] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:34:38 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:34:38.153579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:38.164152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fdcf8-fd6f-4322-b068-4ff65fb29516 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:38.226092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:38.226718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.227027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.227293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.227927 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:38.229850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:38.252903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1107/2226] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:34:38 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:34:38.257139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:38.267555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06795-af3d-4d97-b937-fff95b236c2e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:38.272784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:38.273387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.273661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.273930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.274567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:38.276215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:38.286497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1120/2227] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:34:38.290572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:38.301971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771cf16-7f84-4cd0-b08c-7e478398cad4 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:38.307708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7a459-b557-4b9e-b8f4-b110e52a7d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:38.308315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a459-b557-4b9e-b8f4-b110e52a7d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.308591 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a459-b557-4b9e-b8f4-b110e52a7d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.308857 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a459-b557-4b9e-b8f4-b110e52a7d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.309696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7a459-b557-4b9e-b8f4-b110e52a7d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:38.311356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7a459-b557-4b9e-b8f4-b110e52a7d9d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:38.323112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1108/2228] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:34:38.327645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:38.342129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae5f6b-e4c3-45a7-a4aa-00205d80ec98 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:38.347946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:38.348631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.348911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.349187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] PATH_INFO: `/v3/projects/856e8eabb48e4aa8b3e8b681679d6a6f/users/f96fb17df45648458e7053a9bb975ba0/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.364869 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856e8eabb48e4aa8b3e8b681679d6a6f, user_id=f96fb17df45648458e7053a9bb975ba0, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:38.367646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:38.382290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1121/2229] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:34:38 2022] PUT /identity/v3/projects/856e8eabb48e4aa8b3e8b681679d6a6f/users/f96fb17df45648458e7053a9bb975ba0/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:38.392805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589bf4-94a8-48a6-8c91-237b44bee4ca None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.393111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589bf4-94a8-48a6-8c91-237b44bee4ca None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.393438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589bf4-94a8-48a6-8c91-237b44bee4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.422687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-52589bf4-94a8-48a6-8c91-237b44bee4ca None None] MFA Rules not processed for user `f96fb17df45648458e7053a9bb975ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:38.424288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-52589bf4-94a8-48a6-8c91-237b44bee4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:38.488349 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1109/2230] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:34:38.500087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:38.501984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:38.524532 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:38.563305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868636-c3b0-42b8-bed4-ba0c9297ad27 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:38.567479 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8684992-b6c8-4f33-9636-127ae95a1e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:38.568079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684992-b6c8-4f33-9636-127ae95a1e1a service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:38.568325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684992-b6c8-4f33-9636-127ae95a1e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:38.568622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684992-b6c8-4f33-9636-127ae95a1e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:38.577720 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8684992-b6c8-4f33-9636-127ae95a1e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:38.579172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8684992-b6c8-4f33-9636-127ae95a1e1a service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:38.588241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1122/2231] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:43.649279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589bf4-94a8-48a6-8c91-237b44bee4ca None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:43.671702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:43.718773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589bf4-94a8-48a6-8c91-237b44bee4ca None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:43.723953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:43.724612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:43.724881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:43.725147 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] PATH_INFO: `/v3/users/f96fb17df45648458e7053a9bb975ba0` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:43.726864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96fb17df45648458e7053a9bb975ba0)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:43.730145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:43.785085 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96fb17df45648458e7053a9bb975ba0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:43.792611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96fb17df45648458e7053a9bb975ba0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:43.793338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96fb17df45648458e7053a9bb975ba0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:43.793958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96fb17df45648458e7053a9bb975ba0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:43.805930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96fb17df45648458e7053a9bb975ba0'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:43.825048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1110/2232] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:34:43 2022] DELETE /identity/v3/users/f96fb17df45648458e7053a9bb975ba0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:43.830002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:43.830502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:43.830632 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:43.852571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:34:43.853841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:43.917924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1123/2233] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:34:43.929024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:43.931461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:44.001186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c161a-9c10-4f8f-9922-26f3f5b17633 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:44.005369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:44.005978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:44.006251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:44.006519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:44.016140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:44.017561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:44.027330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1111/2234] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:44.308209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:44.309791 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:44.327695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8572e-4200-4e41-a770-3b48c40e66d2 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:44.334028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:44.334703 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:44.335013 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:44.335294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] PATH_INFO: `/v3/projects/856e8eabb48e4aa8b3e8b681679d6a6f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:44.336506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=856e8eabb48e4aa8b3e8b681679d6a6f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:44.338914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:44.387749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856e8eabb48e4aa8b3e8b681679d6a6f', 'request_id': 'req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:44.397112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856e8eabb48e4aa8b3e8b681679d6a6f', 'request_id': 'req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:44.403475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856e8eabb48e4aa8b3e8b681679d6a6f', 'request_id': 'req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:44.413829 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] The token cache is being invalidate because project 856e8eabb48e4aa8b3e8b681679d6a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:34:44.414141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:44.414811 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:44.416367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1124/2235] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:34:44 2022] DELETE /identity/v3/projects/856e8eabb48e4aa8b3e8b681679d6a6f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:45.813620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:45.816267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:45.833314 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edbf1-df3a-4004-8ea4-43ccb02a0f80 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:45.873449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:45.886911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:45.887518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:45.887782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:45.888065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:45.890028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:45.954434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:45.955896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:45.965477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1112/2236] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:50.975191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:50.976758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:50.989015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6a04-d1c1-427e-bddf-1f8e250d16fb admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:50.992719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:50.993316 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:50.993589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:50.993855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:50.995635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:51.042317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:51.064921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:51.066426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:51.076389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1125/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:55.960809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=30 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:57.447009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:57.448610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:57.465071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2079ecb-fc10-4274-b6e8-2ab76f73c1f6 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:57.470636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:57.471344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:57.471619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:57.471883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] PATH_INFO: `/v3/users/0b9a958c271341e0a473f800b7524eeb` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:57.473107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9a958c271341e0a473f800b7524eeb)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:57.475053 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:57.523841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9a958c271341e0a473f800b7524eeb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.530665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9a958c271341e0a473f800b7524eeb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.531387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9a958c271341e0a473f800b7524eeb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.532079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9a958c271341e0a473f800b7524eeb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.541899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9a958c271341e0a473f800b7524eeb'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.560422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1113/2238] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:34:57 2022] DELETE /identity/v3/users/0b9a958c271341e0a473f800b7524eeb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:57.751891 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:57.762254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6909-088b-4acc-b06a-db4032b54120 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:57.825981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:57.826605 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:57.826905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:57.827166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] PATH_INFO: `/v3/projects/244002836a4645b1bf187b4dd273ab29` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:57.828294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=244002836a4645b1bf187b4dd273ab29)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:57.830286 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:57.881107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244002836a4645b1bf187b4dd273ab29', 'request_id': 'req-070d2cef-1078-475d-b9d6-8980720d9f2d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.889787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244002836a4645b1bf187b4dd273ab29', 'request_id': 'req-070d2cef-1078-475d-b9d6-8980720d9f2d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.896427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244002836a4645b1bf187b4dd273ab29', 'request_id': 'req-070d2cef-1078-475d-b9d6-8980720d9f2d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.907336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] The token cache is being invalidate because project 244002836a4645b1bf187b4dd273ab29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:34:57.907564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.908220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:57.909722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1126/2239] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:34:57 2022] DELETE /identity/v3/projects/244002836a4645b1bf187b4dd273ab29 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:57.913950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:57.915438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:57.930073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b31e2-36d6-4c0b-9e1c-6d86bee222b3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:57.990272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:57.990944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:57.991233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:57.991486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] PATH_INFO: `/v3/users/9499fdf81cb6418eb3a56a7fb35691e6` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:57.992660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9499fdf81cb6418eb3a56a7fb35691e6)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:57.994574 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:58.043212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9499fdf81cb6418eb3a56a7fb35691e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.051167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9499fdf81cb6418eb3a56a7fb35691e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.051879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9499fdf81cb6418eb3a56a7fb35691e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.052518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9499fdf81cb6418eb3a56a7fb35691e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.061227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-474c9f55-36a4-403b-a8d7-0d65c9a900cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9499fdf81cb6418eb3a56a7fb35691e6'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.069208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:58.080897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1114/2240] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:34:57 2022] DELETE /identity/v3/users/9499fdf81cb6418eb3a56a7fb35691e6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:34:58.268471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:34:58.270041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:34:58.285444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d2cef-1078-475d-b9d6-8980720d9f2d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:34:58.348924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:34:58.349571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:34:58.349881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:34:58.350149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] PATH_INFO: `/v3/projects/4956eeaa940545bd93b6642190d2efad` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:34:58.351353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4956eeaa940545bd93b6642190d2efad)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:34:58.353254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:34:58.364823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:58.402999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4956eeaa940545bd93b6642190d2efad', 'request_id': 'req-b457fcbb-2c3a-4f77-b763-58c3cc02790e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.412587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4956eeaa940545bd93b6642190d2efad', 'request_id': 'req-b457fcbb-2c3a-4f77-b763-58c3cc02790e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.418955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4956eeaa940545bd93b6642190d2efad', 'request_id': 'req-b457fcbb-2c3a-4f77-b763-58c3cc02790e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.430341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] The token cache is being invalidate because project 4956eeaa940545bd93b6642190d2efad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:34:58.430626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.431346 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:34:58.432817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1127/2241] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:34:58 2022] DELETE /identity/v3/projects/4956eeaa940545bd93b6642190d2efad => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:35:06.692270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:06.692769 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:06.692868 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:06.713165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:06.714387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:06.772871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1115/2242] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:06.785306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:06.786988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:06.860274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457fcbb-2c3a-4f77-b763-58c3cc02790e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:06.866238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77024699-888a-44d5-8c0f-41a8b720ac10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:06.866992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77024699-888a-44d5-8c0f-41a8b720ac10 service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:06.867287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77024699-888a-44d5-8c0f-41a8b720ac10 service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:06.867572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77024699-888a-44d5-8c0f-41a8b720ac10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:06.878493 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77024699-888a-44d5-8c0f-41a8b720ac10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:06.880167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77024699-888a-44d5-8c0f-41a8b720ac10 service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:06.888338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1128/2243] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:35:16.765104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=28,keystone:DELETE=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:16.885007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:19.667609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:19.669204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:19.814024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84002ed1-8c63-4c6a-bf40-04c6bd0125d3 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:19.820224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f3702-a2cd-4d42-9d9f-982cdca9f021 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:19.820835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3702-a2cd-4d42-9d9f-982cdca9f021 service placement] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:19.821122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3702-a2cd-4d42-9d9f-982cdca9f021 service placement] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:19.821383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3702-a2cd-4d42-9d9f-982cdca9f021 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:19.823464 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e16f3702-a2cd-4d42-9d9f-982cdca9f021 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:19.835576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f3702-a2cd-4d42-9d9f-982cdca9f021 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:19.837210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f3702-a2cd-4d42-9d9f-982cdca9f021 service placement] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:19.847752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1116/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:35:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:35:21.841616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9a95d-5bd5-46f6-b68d-0c4b32e19d76 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:21.842191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9a95d-5bd5-46f6-b68d-0c4b32e19d76 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:21.842191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9a95d-5bd5-46f6-b68d-0c4b32e19d76 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:21.843513 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1129/2245] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:35:21.849990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5d270-bbdd-4fde-96dc-200e01ece0b0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:21.850529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5d270-bbdd-4fde-96dc-200e01ece0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:21.850529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5d270-bbdd-4fde-96dc-200e01ece0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:21.904602 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6ed5d270-bbdd-4fde-96dc-200e01ece0b0 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:21.905863 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6ed5d270-bbdd-4fde-96dc-200e01ece0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:21.955675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:21.992888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1117/2246] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:35:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:22.004711 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9a95d-5bd5-46f6-b68d-0c4b32e19d76 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:22.006399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-49a9a95d-5bd5-46f6-b68d-0c4b32e19d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:22.066776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9a95d-5bd5-46f6-b68d-0c4b32e19d76 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:22.070665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444d08-e5aa-455c-81b4-b37d9b9c2258 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a06e2819ffa4bbcaaf07f8b962c531c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:22.071304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444d08-e5aa-455c-81b4-b37d9b9c2258 service glance] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:22.071583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444d08-e5aa-455c-81b4-b37d9b9c2258 service glance] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:22.071847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444d08-e5aa-455c-81b4-b37d9b9c2258 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:22.082524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444d08-e5aa-455c-81b4-b37d9b9c2258 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:22.084020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444d08-e5aa-455c-81b4-b37d9b9c2258 service glance] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:22.094673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1130/2247] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:35:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:35:22.169040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0660555-901d-4fed-856d-fcee637693c4 None None] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:22.169259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0660555-901d-4fed-856d-fcee637693c4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:22.169492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0660555-901d-4fed-856d-fcee637693c4 None None] PATH_INFO: `/` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:22.170941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1118/2248] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:35:22.176531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234e38-4986-4acd-8346-003d73c485b5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:22.176833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234e38-4986-4acd-8346-003d73c485b5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:22.177221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234e38-4986-4acd-8346-003d73c485b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:22.198050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bf234e38-4986-4acd-8346-003d73c485b5 None None] MFA Rules not processed for user `ed8635b4ce034605bcce301f3f98e721`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:22.199381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bf234e38-4986-4acd-8346-003d73c485b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:22.249448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1131/2249] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:35:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:22.264620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0660555-901d-4fed-856d-fcee637693c4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:22.267788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d0660555-901d-4fed-856d-fcee637693c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:22.290438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0660555-901d-4fed-856d-fcee637693c4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:22.296232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c780-9f6b-4ae6-afb7-3b995c405ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:22.296839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c780-9f6b-4ae6-afb7-3b995c405ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:22.297196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c780-9f6b-4ae6-afb7-3b995c405ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:22.297442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c780-9f6b-4ae6-afb7-3b995c405ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:22.305463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4c780-9f6b-4ae6-afb7-3b995c405ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:22.306948 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4c780-9f6b-4ae6-afb7-3b995c405ef7 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:22.315124 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1119/2250] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:35:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:35:22.399840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13b438-e2dd-4388-8407-a557e1e3e169 None None] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:22.400098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13b438-e2dd-4388-8407-a557e1e3e169 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:22.400405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13b438-e2dd-4388-8407-a557e1e3e169 None None] PATH_INFO: `/` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:22.402051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1132/2251] 10.222.0.16 () {54 vars in 921 bytes} [Tue Oct 11 13:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 13:35:22.407374 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85cfbb-69c6-46d5-ae01-128c4e530bd0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:22.407912 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85cfbb-69c6-46d5-ae01-128c4e530bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:22.408260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85cfbb-69c6-46d5-ae01-128c4e530bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:22.430540 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-af85cfbb-69c6-46d5-ae01-128c4e530bd0 None None] MFA Rules not processed for user `c81304f420a447a1a488a941d4075513`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:22.431808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-af85cfbb-69c6-46d5-ae01-128c4e530bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:22.441663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1120/2252] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Oct 11 13:35:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:22.452221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13b438-e2dd-4388-8407-a557e1e3e169 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:22.454164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cb13b438-e2dd-4388-8407-a557e1e3e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:22.473011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13b438-e2dd-4388-8407-a557e1e3e169 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:22.478446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:22.486311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:22.486640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:22.486943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:22.498201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:22.499715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:22.511463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1133/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:35:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:35:25.261944 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa7abc-62d2-4aeb-aa67-2d19bb7e9206 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:25.262445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa7abc-62d2-4aeb-aa67-2d19bb7e9206 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:25.262445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa7abc-62d2-4aeb-aa67-2d19bb7e9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:25.282599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-a4fa7abc-62d2-4aeb-aa67-2d19bb7e9206 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:25.283846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a4fa7abc-62d2-4aeb-aa67-2d19bb7e9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:25.291508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1121/2254] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Oct 11 13:35:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:25.304098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:25.315749 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68f174-da5a-48d7-97c4-1c892cfdbe72 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:25.324055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:25.324814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:25.325193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:25.325656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:25.335089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:25.336919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:25.346341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1134/2255] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:35:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:35:35.276877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=26 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:35.343421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=61 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:44.967399 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5655-b62d-43a5-8f3d-7d9e09dd7649 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:44.968015 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5655-b62d-43a5-8f3d-7d9e09dd7649 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:44.968015 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5655-b62d-43a5-8f3d-7d9e09dd7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:44.989883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-12ff5655-b62d-43a5-8f3d-7d9e09dd7649 None None] MFA Rules not processed for user `91dd568b808244adb9337114b2c3986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:44.991410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-12ff5655-b62d-43a5-8f3d-7d9e09dd7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:44.999109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1122/2256] 10.222.0.16 () {58 vars in 967 bytes} [Tue Oct 11 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:45.011735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:45.022210 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f8ca1-91ea-4762-81fe-70b40f97f272 service swift] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:45.027655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49febc522c0845be9c92b13169bdbc68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:45.028193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:45.028525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:45.028846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:45.037147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:45.038780 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:45.047071 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1135/2257] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Oct 11 13:35:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 13:35:53.372532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff5655-b62d-43a5-8f3d-7d9e09dd7649 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:53.392181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff5655-b62d-43a5-8f3d-7d9e09dd7649 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:53.396227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:53.396835 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:53.397113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:53.397383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:53.399314 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:53.485227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:53.486650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:53.506800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1123/2258] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:35:55.043685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:56.661769 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:56.663566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:56.685453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d276-fa10-482b-96c8-1c887b1f6bf2 service swift] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:56.690014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:56.690664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:56.691135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:56.691404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] PATH_INFO: `/v3/users/4ac6d0fcbeb7496db5bb873d99e1c20f` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:56.692511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac6d0fcbeb7496db5bb873d99e1c20f)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:56.694421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:56.743143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac6d0fcbeb7496db5bb873d99e1c20f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:56.750504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac6d0fcbeb7496db5bb873d99e1c20f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:56.751196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac6d0fcbeb7496db5bb873d99e1c20f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:56.752689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac6d0fcbeb7496db5bb873d99e1c20f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:56.759695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e1927c0f-7324-4d01-a959-6a7fa52c62e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac6d0fcbeb7496db5bb873d99e1c20f'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:56.781429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1136/2259] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:35:56 2022] DELETE /identity/v3/users/4ac6d0fcbeb7496db5bb873d99e1c20f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:35:56.960563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:56.972693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15450-4be0-4169-92fb-1aa469857838 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.032678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.033447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.033724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.033992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] PATH_INFO: `/v3/projects/0f3e94c055ac4701ae2b1d0734ef086d` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.035276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3e94c055ac4701ae2b1d0734ef086d)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.037193 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.086211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3e94c055ac4701ae2b1d0734ef086d', 'request_id': 'req-4e18e16c-48f6-4b20-a69c-6f71503c120c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:57.088780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:57.095792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3e94c055ac4701ae2b1d0734ef086d', 'request_id': 'req-4e18e16c-48f6-4b20-a69c-6f71503c120c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:57.103443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3e94c055ac4701ae2b1d0734ef086d', 'request_id': 'req-4e18e16c-48f6-4b20-a69c-6f71503c120c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:57.114864 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] The token cache is being invalidate because project 0f3e94c055ac4701ae2b1d0734ef086d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:35:57.115060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:57.115854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4e18e16c-48f6-4b20-a69c-6f71503c120c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:35:57.117488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1124/2260] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:35:56 2022] DELETE /identity/v3/projects/0f3e94c055ac4701ae2b1d0734ef086d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:35:57.123102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84b1f-076d-4c33-81ec-1955f1914a01 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.123741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84b1f-076d-4c33-81ec-1955f1914a01 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.124046 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84b1f-076d-4c33-81ec-1955f1914a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.176241 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-42d84b1f-076d-4c33-81ec-1955f1914a01 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:57.177443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-42d84b1f-076d-4c33-81ec-1955f1914a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:57.235959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1137/2261] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:57.244151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebe11-ae68-4cf5-94c2-038eda7e01b1 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.244430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebe11-ae68-4cf5-94c2-038eda7e01b1 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.244699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebe11-ae68-4cf5-94c2-038eda7e01b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.265847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d26ebe11-ae68-4cf5-94c2-038eda7e01b1 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:57.267076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d26ebe11-ae68-4cf5-94c2-038eda7e01b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:57.276190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1125/2262] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:35:57.281192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d84b1f-076d-4c33-81ec-1955f1914a01 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:57.296383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d84b1f-076d-4c33-81ec-1955f1914a01 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.304876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.305765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.306156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.306556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.307572 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:35:57.307992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.310559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.323565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1138/2263] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:35:57.328457 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebe11-ae68-4cf5-94c2-038eda7e01b1 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:57.338775 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebe11-ae68-4cf5-94c2-038eda7e01b1 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.344223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.344826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.345128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.345398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.346048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.348002 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.379099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1126/2264] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:35:57 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:35:57.384032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:57.396552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576328b1-8c1d-49fa-84a4-d035c33119f8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.431807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:57.457425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.458025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.458302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.458567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.459246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.461149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.484600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1139/2265] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:35:57 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:35:57.488862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:57.499778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e617f-ecad-470e-acbe-d91f05ba2c26 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.505518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.506130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.506404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.506673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.507368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.508991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.519977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1127/2266] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:35:57.524855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:57.541007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378192f-1a87-4154-80a0-99b2f881b341 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.548217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60232c84-6d12-4a51-9efa-626b87480783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.548838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60232c84-6d12-4a51-9efa-626b87480783 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.549107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60232c84-6d12-4a51-9efa-626b87480783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.549378 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60232c84-6d12-4a51-9efa-626b87480783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.550310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60232c84-6d12-4a51-9efa-626b87480783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.551935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60232c84-6d12-4a51-9efa-626b87480783 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.561962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1140/2267] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:35:57.566144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:57.576068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8268ad9-8fc3-4fe0-be8f-02f5ecb44c49 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.581233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.581872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.582145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.582409 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] PATH_INFO: `/v3/projects/466be70a50e74afd9cd4c7005a0bbe02/users/18c2669e28e24bb29a8e57d45dfd3270/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.597570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466be70a50e74afd9cd4c7005a0bbe02, user_id=18c2669e28e24bb29a8e57d45dfd3270, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.600223 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.616577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1128/2268] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:35:57 2022] PUT /identity/v3/projects/466be70a50e74afd9cd4c7005a0bbe02/users/18c2669e28e24bb29a8e57d45dfd3270/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:35:57.621727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab533afd-c37b-4ee3-a762-f889f5ae0ec3 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.622001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab533afd-c37b-4ee3-a762-f889f5ae0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.622282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab533afd-c37b-4ee3-a762-f889f5ae0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.641864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ab533afd-c37b-4ee3-a762-f889f5ae0ec3 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:35:57.643019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ab533afd-c37b-4ee3-a762-f889f5ae0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:57.703713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1141/2269] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:35:57.713517 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:35:57.715477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:35:57.791011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a615ec7-a380-4e64-926b-8aeaa6c9c848 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:35:57.795533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:35:57.796160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:35:57.796436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:35:57.796708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:35:57.807369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:35:57.808810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:35:57.819152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1129/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:36:01.779044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce2b6d-55a1-4111-bf49-1a65e70f119b None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:01.779616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce2b6d-55a1-4111-bf49-1a65e70f119b None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:01.779741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce2b6d-55a1-4111-bf49-1a65e70f119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:01.809800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d8ce2b6d-55a1-4111-bf49-1a65e70f119b None None] MFA Rules not processed for user `18c2669e28e24bb29a8e57d45dfd3270`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:01.811405 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d8ce2b6d-55a1-4111-bf49-1a65e70f119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:01.881481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1142/2271] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:01.896180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:01.898306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:01.976362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449c9c-ed53-4e40-8a4d-923638bbbc21 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:01.982026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:01.982778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:01.983094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:01.983366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:01.988417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:01.992867 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:01.995030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:02.005771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1130/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:36:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:36:03.308331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:03.308841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:03.308925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:03.331587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] MFA Rules not processed for user `18c2669e28e24bb29a8e57d45dfd3270`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:03.332899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:03.340738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1143/2273] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:12.006936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:13.324928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:48.482511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:48.492876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1147-137e-4d0c-bc77-957833ae4565 service nova] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:48.497627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:48.498231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:48.498470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:48.498764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:48.500900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:48.514213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:48.515648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:48.525541 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1131/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:36:51.717879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:51.719575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:51.735500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14e673-6ef4-46dc-9d47-fa0623b91c59 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:51.741381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:51.742039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:51.742318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:51.743103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] PATH_INFO: `/v3/users/532592384a174f4aade6ab3565fd32d3` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:51.744418 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532592384a174f4aade6ab3565fd32d3)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:51.746485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:51.799876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532592384a174f4aade6ab3565fd32d3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:51.807266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532592384a174f4aade6ab3565fd32d3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:51.807921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532592384a174f4aade6ab3565fd32d3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:51.808518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532592384a174f4aade6ab3565fd32d3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:51.816016 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-caba76fd-236d-4903-b2d5-bf38c3232502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532592384a174f4aade6ab3565fd32d3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:51.836089 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1144/2275] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:36:51 2022] DELETE /identity/v3/users/532592384a174f4aade6ab3565fd32d3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:36:52.014115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.024932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ef0d-e5ab-4ff6-8251-31fe9ea93cdd service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.084152 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.084832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.085105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.085360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] PATH_INFO: `/v3/projects/17496a87829e4e6a8d4d33d2736ca5ea` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.086534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=17496a87829e4e6a8d4d33d2736ca5ea)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.088485 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.137479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17496a87829e4e6a8d4d33d2736ca5ea', 'request_id': 'req-29db0d42-a289-4675-b99b-65fd114466ee'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:52.145804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17496a87829e4e6a8d4d33d2736ca5ea', 'request_id': 'req-29db0d42-a289-4675-b99b-65fd114466ee'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:52.152755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17496a87829e4e6a8d4d33d2736ca5ea', 'request_id': 'req-29db0d42-a289-4675-b99b-65fd114466ee'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:52.163574 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] The token cache is being invalidate because project 17496a87829e4e6a8d4d33d2736ca5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:36:52.163859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:52.164570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-29db0d42-a289-4675-b99b-65fd114466ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:52.166202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1132/2276] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:36:52 2022] DELETE /identity/v3/projects/17496a87829e4e6a8d4d33d2736ca5ea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:36:52.171390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c985a8-64c7-42ae-b94f-ccf6207efa2e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.171730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c985a8-64c7-42ae-b94f-ccf6207efa2e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.172008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c985a8-64c7-42ae-b94f-ccf6207efa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.195015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-a6c985a8-64c7-42ae-b94f-ccf6207efa2e None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:52.196295 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-a6c985a8-64c7-42ae-b94f-ccf6207efa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:52.260165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1145/2277] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:52.271093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671902c-2f5b-46ad-98d6-d26837e621b9 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.271443 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671902c-2f5b-46ad-98d6-d26837e621b9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.271717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671902c-2f5b-46ad-98d6-d26837e621b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.292695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9671902c-2f5b-46ad-98d6-d26837e621b9 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:52.293935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9671902c-2f5b-46ad-98d6-d26837e621b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:52.302647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1133/2278] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:52.307291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c985a8-64c7-42ae-b94f-ccf6207efa2e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.317325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c985a8-64c7-42ae-b94f-ccf6207efa2e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.323552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.324180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.324453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.324716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.325383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:36:52.325678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.327437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.342588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1146/2279] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 13:36:52.347390 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671902c-2f5b-46ad-98d6-d26837e621b9 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.357552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671902c-2f5b-46ad-98d6-d26837e621b9 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.363433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.364056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.364335 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.364607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.365240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.367472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.400990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1134/2280] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:36:52 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:36:52.405432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.416436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c650-6542-4a14-84f5-ac44fb2ed917 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.474467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.475119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.475546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.475985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.476702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.478647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.486688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:52.503263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1147/2281] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:36:52 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:36:52.507488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.518220 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6bd6-98b1-441f-82f4-43a7e2e344fc admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.523289 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.523890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.524688 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.524975 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.525626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.527267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.537614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1135/2282] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:36:52.541768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.552722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840eb6-6cc2-49fa-8332-1d032d376d16 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.558610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f80f9-56bc-4797-bb4d-f8875a1538fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.559244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f80f9-56bc-4797-bb4d-f8875a1538fe admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.559514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f80f9-56bc-4797-bb4d-f8875a1538fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.559781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f80f9-56bc-4797-bb4d-f8875a1538fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.560392 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f80f9-56bc-4797-bb4d-f8875a1538fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.561999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f80f9-56bc-4797-bb4d-f8875a1538fe admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.573171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1148/2283] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:36:52.577532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.588054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb5405-4091-43fa-9f4a-7d99faf08a25 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.593357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.594007 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.594282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.594551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] PATH_INFO: `/v3/projects/5cfa1d284fc64afea072446e6acca1f1/users/fd1f6d68837b4f3783929524dd679778/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.609202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfa1d284fc64afea072446e6acca1f1, user_id=fd1f6d68837b4f3783929524dd679778, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.611854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.632814 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1136/2284] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:36:52 2022] PUT /identity/v3/projects/5cfa1d284fc64afea072446e6acca1f1/users/fd1f6d68837b4f3783929524dd679778/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:36:52.643256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7e6b6-8d11-4458-8283-d5b570efe006 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.643536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7e6b6-8d11-4458-8283-d5b570efe006 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.643831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7e6b6-8d11-4458-8283-d5b570efe006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.672285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e3b7e6b6-8d11-4458-8283-d5b570efe006 None None] MFA Rules not processed for user `fd1f6d68837b4f3783929524dd679778`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:52.673464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e3b7e6b6-8d11-4458-8283-d5b570efe006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:52.742501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1149/2285] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:36:52.753694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:52.755872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:52.771587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:52.834380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdce7df-d75b-46b4-a094-bbc027036a3f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:52.840519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf62cb-5a5c-4aff-9075-ab5ee60e9dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:52.841122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf62cb-5a5c-4aff-9075-ab5ee60e9dd9 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:52.841400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf62cb-5a5c-4aff-9075-ab5ee60e9dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:52.841671 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf62cb-5a5c-4aff-9075-ab5ee60e9dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:52.849638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf62cb-5a5c-4aff-9075-ab5ee60e9dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:52.851254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf62cb-5a5c-4aff-9075-ab5ee60e9dd9 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:52.860090 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1137/2286] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:36:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:36:55.598206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7e6b6-8d11-4458-8283-d5b570efe006 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:55.665590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7e6b6-8d11-4458-8283-d5b570efe006 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:55.671109 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:55.671745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:55.672017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:55.672270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] PATH_INFO: `/v3/users/fd1f6d68837b4f3783929524dd679778` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:55.673488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1f6d68837b4f3783929524dd679778)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:55.675478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:55.727117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1f6d68837b4f3783929524dd679778'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:55.738029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1f6d68837b4f3783929524dd679778'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:55.739140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1f6d68837b4f3783929524dd679778'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:55.740040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1f6d68837b4f3783929524dd679778'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:55.749982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1f6d68837b4f3783929524dd679778'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:55.755453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:55.769983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1150/2287] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:36:55 2022] DELETE /identity/v3/users/fd1f6d68837b4f3783929524dd679778 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:36:55.775050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:55.775558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:55.775657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:55.795389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:55.796606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:55.860689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1138/2288] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:36:55.870601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:55.872147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:55.930940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7966b68-5557-4af6-9d7f-2018e72ca8dc admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:55.935017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f5a77-b70b-421d-8249-62f08105d75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:55.935622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f5a77-b70b-421d-8249-62f08105d75c service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:55.935899 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f5a77-b70b-421d-8249-62f08105d75c service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:55.936165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f5a77-b70b-421d-8249-62f08105d75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:55.946354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f5a77-b70b-421d-8249-62f08105d75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:55.947871 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f5a77-b70b-421d-8249-62f08105d75c service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:55.957722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1151/2289] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:36:56.238191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.239734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:56.251881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb526e5a-b038-4e4d-a8f7-648524af7ae7 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.257115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.257753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.258095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.258363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] PATH_INFO: `/v3/projects/5cfa1d284fc64afea072446e6acca1f1` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.259612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfa1d284fc64afea072446e6acca1f1)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.261524 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.309776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfa1d284fc64afea072446e6acca1f1', 'request_id': 'req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:56.318339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfa1d284fc64afea072446e6acca1f1', 'request_id': 'req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:56.325404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfa1d284fc64afea072446e6acca1f1', 'request_id': 'req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:56.337123 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] The token cache is being invalidate because project 5cfa1d284fc64afea072446e6acca1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:36:56.337398 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:56.338113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-04f67a11-3da3-4a50-b7a3-7f91f6b4fd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:36:56.339720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1139/2290] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:36:56 2022] DELETE /identity/v3/projects/5cfa1d284fc64afea072446e6acca1f1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:36:56.344808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0c0c-2f2c-44a9-bbe9-91a844c5454d None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.345090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0c0c-2f2c-44a9-bbe9-91a844c5454d None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.345363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0c0c-2f2c-44a9-bbe9-91a844c5454d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.366269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-493a0c0c-2f2c-44a9-bbe9-91a844c5454d None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:56.367472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-493a0c0c-2f2c-44a9-bbe9-91a844c5454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:56.431722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1152/2291] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:56.441015 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80ed9-394b-41e7-bb87-87638a6b589c None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.441326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80ed9-394b-41e7-bb87-87638a6b589c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.441594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80ed9-394b-41e7-bb87-87638a6b589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.462518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-21c80ed9-394b-41e7-bb87-87638a6b589c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:56.463745 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-21c80ed9-394b-41e7-bb87-87638a6b589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:56.472841 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1140/2292] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:56.478032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a0c0c-2f2c-44a9-bbe9-91a844c5454d None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.489737 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a0c0c-2f2c-44a9-bbe9-91a844c5454d None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.495619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.496250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.496527 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.496796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.497430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:36:56.497723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.499363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.511385 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1153/2293] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:36:56.516101 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c80ed9-394b-41e7-bb87-87638a6b589c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.525812 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c80ed9-394b-41e7-bb87-87638a6b589c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.531015 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.531620 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.531894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.532180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.532785 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.534796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.550768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:56.566774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1141/2294] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:36:56 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:36:56.571045 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.581363 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312558e3-8f21-4fe1-98e2-29b04d472f7b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.640290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.640925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.641104 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.641367 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.641983 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.643985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.667371 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1154/2295] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:36:56 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:36:56.671846 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.683249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbe4b3-bd33-4b8a-9832-26c3722d0ca3 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.689089 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.689719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.689991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.690317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.690976 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.692690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.703576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1142/2296] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:36:56.707842 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.718020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea133e-0bda-480b-9608-9302258155a3 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.723102 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeefec-cf28-44c3-ad83-feedf4a8897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.723701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeefec-cf28-44c3-ad83-feedf4a8897d admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.723974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeefec-cf28-44c3-ad83-feedf4a8897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.724246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeefec-cf28-44c3-ad83-feedf4a8897d admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.724910 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeefec-cf28-44c3-ad83-feedf4a8897d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.726518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeefec-cf28-44c3-ad83-feedf4a8897d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.727861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:56.738758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1155/2297] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:36:56.741977 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.752092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4d47f-142a-4770-b972-a82c69d5fc50 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.757298 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.757968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.758254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.758682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] PATH_INFO: `/v3/projects/fdfe920b798b41d1bbd6c25cef4cee48/users/6025d58d4e5f40a394f9006470335a3a/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.774571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfe920b798b41d1bbd6c25cef4cee48, user_id=6025d58d4e5f40a394f9006470335a3a, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.777272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.795301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1143/2298] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:36:56 2022] PUT /identity/v3/projects/fdfe920b798b41d1bbd6c25cef4cee48/users/6025d58d4e5f40a394f9006470335a3a/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:36:56.800585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ce843-33a3-4018-8f6f-ce356a5638de None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.801237 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ce843-33a3-4018-8f6f-ce356a5638de None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.801511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ce843-33a3-4018-8f6f-ce356a5638de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.824399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-312ce843-33a3-4018-8f6f-ce356a5638de None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:56.825612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-312ce843-33a3-4018-8f6f-ce356a5638de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:56.886192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1156/2299] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:56.896282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:56.898496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:56.960992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0910f4-c01d-4997-bbfd-b62b868da7ad admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:56.964970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:56.965571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:56.965840 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:56.966109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:56.975716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:56.977176 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:56.987195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1144/2300] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:36:57.627087 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1d51-80e7-43d9-bec9-926063989153 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:57.627453 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1d51-80e7-43d9-bec9-926063989153 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:57.627808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1d51-80e7-43d9-bec9-926063989153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:57.658650 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-b99d1d51-80e7-43d9-bec9-926063989153 None None] MFA Rules not processed for user `6025d58d4e5f40a394f9006470335a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:57.659908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b99d1d51-80e7-43d9-bec9-926063989153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:57.727664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1157/2301] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:36:57.732339 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:57.742673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b77ff6-5363-4185-87eb-f7330b0efea2 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:57.748279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:57.748896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:57.749236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:57.749577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:57.750275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:57.753941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:57.785587 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1145/2302] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:36:57 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:36:57.789897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1d51-80e7-43d9-bec9-926063989153 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:57.801816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1d51-80e7-43d9-bec9-926063989153 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:57.858218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:57.858884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:57.859163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:57.859434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:57.860058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:57.861982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:57.885487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1158/2303] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:36:57 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:36:57.889623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:57.900613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3f979-3f99-48e4-8284-ea042da51678 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:57.905656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:57.906255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:57.906498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:57.906761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:57.907429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:57.908999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:57.919741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1146/2304] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:36:57.923862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:57.935050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0849f1-13c9-434b-8fdb-5e481583cbab admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:57.940380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:57.941040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:57.941317 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:57.941584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] PATH_INFO: `/v3/projects/532ce386eacd4fe0b6ae194f8edf839d/users/f7a20c87a09f4b0ea0d5205bfaa79503/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:57.956370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:57.960127 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532ce386eacd4fe0b6ae194f8edf839d, user_id=f7a20c87a09f4b0ea0d5205bfaa79503, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:57.963159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:57.982344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1159/2305] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:36:57 2022] PUT /identity/v3/projects/532ce386eacd4fe0b6ae194f8edf839d/users/f7a20c87a09f4b0ea0d5205bfaa79503/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:36:57.986523 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:57.996586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c0f9-f7d1-4ce6-b214-05e3e4b2f3d5 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:58.055400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9828404-c949-4d10-822c-479a5b9652e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:58.055935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828404-c949-4d10-822c-479a5b9652e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:58.056210 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828404-c949-4d10-822c-479a5b9652e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:58.056477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828404-c949-4d10-822c-479a5b9652e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:58.057148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9828404-c949-4d10-822c-479a5b9652e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:58.058853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9828404-c949-4d10-822c-479a5b9652e4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:58.068788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1147/2306] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:36:58.073640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:36:58.088214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcc18-103d-44d8-8dd4-9ff1c54606a7 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:36:58.093730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:36:58.094407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:58.094678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:58.094952 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] PATH_INFO: `/v3/projects/532ce386eacd4fe0b6ae194f8edf839d/users/f7a20c87a09f4b0ea0d5205bfaa79503/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:58.097157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532ce386eacd4fe0b6ae194f8edf839d, user_id=f7a20c87a09f4b0ea0d5205bfaa79503, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:36:58.100019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:36:58.111607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1160/2307] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:36:58 2022] PUT /identity/v3/projects/532ce386eacd4fe0b6ae194f8edf839d/users/f7a20c87a09f4b0ea0d5205bfaa79503/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:36:59.029594 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f2c3-93e1-42ec-b758-ab92f9dc9319 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:36:59.030105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f2c3-93e1-42ec-b758-ab92f9dc9319 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:36:59.030202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f2c3-93e1-42ec-b758-ab92f9dc9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:36:59.060550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-24e5f2c3-93e1-42ec-b758-ab92f9dc9319 None None] MFA Rules not processed for user `f7a20c87a09f4b0ea0d5205bfaa79503`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:36:59.061952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-24e5f2c3-93e1-42ec-b758-ab92f9dc9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:36:59.074910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:59.137205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1148/2308] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:36:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:00.234096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:00.300076 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223877ac-6a99-4cca-99a2-57b06624cee4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:00.305231 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:00.306099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:00.306377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:00.306643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] PATH_INFO: `/v3/users/6025d58d4e5f40a394f9006470335a3a` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:00.307824 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6025d58d4e5f40a394f9006470335a3a)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:00.309773 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:00.359131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6025d58d4e5f40a394f9006470335a3a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.369389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6025d58d4e5f40a394f9006470335a3a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.370139 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6025d58d4e5f40a394f9006470335a3a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.370874 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6025d58d4e5f40a394f9006470335a3a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.379697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6025d58d4e5f40a394f9006470335a3a'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.397287 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1161/2309] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:00 2022] DELETE /identity/v3/users/6025d58d4e5f40a394f9006470335a3a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:00.586549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f2c3-93e1-42ec-b758-ab92f9dc9319 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:00.599651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f2c3-93e1-42ec-b758-ab92f9dc9319 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:00.659758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:00.660402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:00.660680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:00.660951 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] PATH_INFO: `/v3/projects/fdfe920b798b41d1bbd6c25cef4cee48` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:00.662120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfe920b798b41d1bbd6c25cef4cee48)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:00.664077 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:00.714018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfe920b798b41d1bbd6c25cef4cee48', 'request_id': 'req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.723064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfe920b798b41d1bbd6c25cef4cee48', 'request_id': 'req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.729850 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfe920b798b41d1bbd6c25cef4cee48', 'request_id': 'req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.740303 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] The token cache is being invalidate because project fdfe920b798b41d1bbd6c25cef4cee48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:00.740595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.741229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.742788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1149/2310] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:00 2022] DELETE /identity/v3/projects/fdfe920b798b41d1bbd6c25cef4cee48 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:00.747180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:00.748607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:00.761741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a66e0-cef5-4099-bb4d-3e99ab955851 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:00.813765 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:00.823404 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:00.824048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:00.824466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:00.824808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] PATH_INFO: `/v3/users/f7a20c87a09f4b0ea0d5205bfaa79503` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:00.826004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a20c87a09f4b0ea0d5205bfaa79503)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:00.828627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:00.875954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a20c87a09f4b0ea0d5205bfaa79503'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.883061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a20c87a09f4b0ea0d5205bfaa79503'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.883778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a20c87a09f4b0ea0d5205bfaa79503'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.884387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a20c87a09f4b0ea0d5205bfaa79503'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.893739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-01b35bcf-fb8f-4b6e-a7e5-2a15bb05a95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a20c87a09f4b0ea0d5205bfaa79503'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:00.911560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1162/2311] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:00 2022] DELETE /identity/v3/users/f7a20c87a09f4b0ea0d5205bfaa79503 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:01.101766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.103416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:01.120505 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7ee73-9c46-4936-bb43-b3f71cdbd6cc admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.162024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:01.183501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.184173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.184421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.184693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] PATH_INFO: `/v3/projects/532ce386eacd4fe0b6ae194f8edf839d` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.185848 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532ce386eacd4fe0b6ae194f8edf839d)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.187794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.241563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532ce386eacd4fe0b6ae194f8edf839d', 'request_id': 'req-2618f167-e09c-43f5-a01b-448e10f46638'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:01.251849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532ce386eacd4fe0b6ae194f8edf839d', 'request_id': 'req-2618f167-e09c-43f5-a01b-448e10f46638'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:01.258781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532ce386eacd4fe0b6ae194f8edf839d', 'request_id': 'req-2618f167-e09c-43f5-a01b-448e10f46638'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:01.269708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] The token cache is being invalidate because project 532ce386eacd4fe0b6ae194f8edf839d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:01.270005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:01.270687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2618f167-e09c-43f5-a01b-448e10f46638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:01.272241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1150/2312] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:01 2022] DELETE /identity/v3/projects/532ce386eacd4fe0b6ae194f8edf839d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:01.277497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a048-c38a-4d02-908c-9a692ba0b132 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.277965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a048-c38a-4d02-908c-9a692ba0b132 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.278100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a048-c38a-4d02-908c-9a692ba0b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.298434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2866a048-c38a-4d02-908c-9a692ba0b132 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:01.299665 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2866a048-c38a-4d02-908c-9a692ba0b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:01.359328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1163/2313] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:37:01.367183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03cf93-e3e6-431a-a825-431629f88ba3 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.367470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03cf93-e3e6-431a-a825-431629f88ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.367771 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03cf93-e3e6-431a-a825-431629f88ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.393062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8a03cf93-e3e6-431a-a825-431629f88ba3 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:01.394670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8a03cf93-e3e6-431a-a825-431629f88ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:01.408423 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1151/2314] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:01.413201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a048-c38a-4d02-908c-9a692ba0b132 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.423351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a048-c38a-4d02-908c-9a692ba0b132 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.428689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.429285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.429558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.429824 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.430463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:37:01.430941 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.432440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.444137 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1164/2315] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:37:01.449065 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03cf93-e3e6-431a-a825-431629f88ba3 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.458703 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03cf93-e3e6-431a-a825-431629f88ba3 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.464766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.465371 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.465648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.465920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.466547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.468494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.503869 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1152/2316] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:01 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:01.510130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.520668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6170131-5cef-4471-8072-3e2b5f50726c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.580468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.581080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.581395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.581655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.582291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.584273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.594976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:01.609334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1165/2317] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:01 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:01.613446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.624780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08961-558e-4db0-abf4-8431b10b1e63 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.629668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.630271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.630550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.630862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.631509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.633104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.643639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1153/2318] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:01.647955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.658835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeae2-5802-41cb-bd60-2cdfb2f425b4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.664957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466ac12-6357-4f24-8d75-a2b263bb1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.665555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466ac12-6357-4f24-8d75-a2b263bb1085 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.665834 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466ac12-6357-4f24-8d75-a2b263bb1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.666100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466ac12-6357-4f24-8d75-a2b263bb1085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.666723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466ac12-6357-4f24-8d75-a2b263bb1085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.668386 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466ac12-6357-4f24-8d75-a2b263bb1085 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.680173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1166/2319] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:01.684818 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.695716 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacce77f-9564-4066-ae9b-84af2bff7f73 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.701116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.701767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.702051 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.702321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] PATH_INFO: `/v3/projects/ee46f5e5f7c1495fb509cfa0e455866a/users/19e733139f5644fb929e712ee8c4589e/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.718332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee46f5e5f7c1495fb509cfa0e455866a, user_id=19e733139f5644fb929e712ee8c4589e, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.721000 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.737455 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1154/2320] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:01 2022] PUT /identity/v3/projects/ee46f5e5f7c1495fb509cfa0e455866a/users/19e733139f5644fb929e712ee8c4589e/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:01.748610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd485-a0ce-4d89-9f78-23b46266a9ea None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.748895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd485-a0ce-4d89-9f78-23b46266a9ea None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.749170 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd485-a0ce-4d89-9f78-23b46266a9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.778627 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f52bd485-a0ce-4d89-9f78-23b46266a9ea None None] MFA Rules not processed for user `19e733139f5644fb929e712ee8c4589e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:01.779894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f52bd485-a0ce-4d89-9f78-23b46266a9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:01.848830 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1167/2321] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:01.853516 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.919383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb7c1d-2e96-4cad-9eda-8d3df2b806ec admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:01.925851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:01.926807 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:01.927112 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:01.927405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:01.928046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:01.929983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:01.945800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:01.968236 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1155/2322] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:01 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:01.972598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd485-a0ce-4d89-9f78-23b46266a9ea None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:01.983730 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd485-a0ce-4d89-9f78-23b46266a9ea None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:02.048113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:02.048992 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.049393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.049762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.050715 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:02.055275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:02.086654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1168/2323] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:01 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:02.093133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:02.107883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe0c25-138a-43f9-a7f9-bf788aea001b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:02.114014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:02.114624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.114931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.115202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.115842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:02.117469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:02.129118 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1156/2324] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:37:02.133922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:02.144998 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9af9f-b8f2-43f3-94e4-fa6879a414b5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:02.150444 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:02.151103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.151381 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.151646 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] PATH_INFO: `/v3/projects/37dc324d0f3341f8a096e7fccbe04db5/users/2196542c92be4f7e8707da057391ec17/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.169121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dc324d0f3341f8a096e7fccbe04db5, user_id=2196542c92be4f7e8707da057391ec17, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:02.173395 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:02.193747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1169/2325] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:02 2022] PUT /identity/v3/projects/37dc324d0f3341f8a096e7fccbe04db5/users/2196542c92be4f7e8707da057391ec17/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:02.197949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:02.208427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef56d1-51e7-4b23-bb5d-8ecd40936422 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:02.266445 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f653aa-4dcd-42f8-b62f-d4adb69062d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:02.267071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f653aa-4dcd-42f8-b62f-d4adb69062d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.267350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f653aa-4dcd-42f8-b62f-d4adb69062d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.267613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f653aa-4dcd-42f8-b62f-d4adb69062d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.268247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f653aa-4dcd-42f8-b62f-d4adb69062d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:02.269822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f653aa-4dcd-42f8-b62f-d4adb69062d5 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:02.280271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1157/2326] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:02.284700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:02.297331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8711d07-ad2d-4499-aabc-e7680835e503 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:02.302896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:02.303578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.303854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.304124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] PATH_INFO: `/v3/projects/37dc324d0f3341f8a096e7fccbe04db5/users/2196542c92be4f7e8707da057391ec17/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.306194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dc324d0f3341f8a096e7fccbe04db5, user_id=2196542c92be4f7e8707da057391ec17, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:02.308932 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:02.320040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1170/2327] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:02 2022] PUT /identity/v3/projects/37dc324d0f3341f8a096e7fccbe04db5/users/2196542c92be4f7e8707da057391ec17/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:02.332507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea8f1-0fda-40e0-86df-31f803bed19a None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.332829 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea8f1-0fda-40e0-86df-31f803bed19a None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.333153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea8f1-0fda-40e0-86df-31f803bed19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.361282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-c5bea8f1-0fda-40e0-86df-31f803bed19a None None] MFA Rules not processed for user `2196542c92be4f7e8707da057391ec17`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:02.362477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c5bea8f1-0fda-40e0-86df-31f803bed19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:02.436173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1158/2328] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:02.448448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:02.450409 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:02.478575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:02.531126 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0376f8-f2d8-4e6a-8fdc-e81bbaf56e59 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:02.535569 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:02.536208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.536488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.536764 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.546519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:02.548037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:02.560101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1171/2329] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:02.655316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea8f1-0fda-40e0-86df-31f803bed19a None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:02.665044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea8f1-0fda-40e0-86df-31f803bed19a None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:02.669099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ac623-9187-44ff-a882-115ef1a13436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:02.669694 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ac623-9187-44ff-a882-115ef1a13436 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:02.669970 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ac623-9187-44ff-a882-115ef1a13436 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:02.670233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ac623-9187-44ff-a882-115ef1a13436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:02.737886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ac623-9187-44ff-a882-115ef1a13436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:02.739431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ac623-9187-44ff-a882-115ef1a13436 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:02.744361 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:02.749561 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1159/2330] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:09.955080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:10.017403 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb318c-bd55-46fc-9567-663ea2e0caa8 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:10.022351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:10.023014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:10.023293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:10.023587 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] PATH_INFO: `/v3/users/19e733139f5644fb929e712ee8c4589e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:10.024770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e733139f5644fb929e712ee8c4589e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:10.026890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:10.089217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e733139f5644fb929e712ee8c4589e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.096138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e733139f5644fb929e712ee8c4589e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.096839 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e733139f5644fb929e712ee8c4589e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.097518 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e733139f5644fb929e712ee8c4589e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.106526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e733139f5644fb929e712ee8c4589e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.124926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1172/2331] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:09 2022] DELETE /identity/v3/users/19e733139f5644fb929e712ee8c4589e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:10.134749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:10.135473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:10.135473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:10.155212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:10.156400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:10.219128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1160/2332] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:10.229422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:10.231208 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:10.263678 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:10.293182 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777819ab-cf3b-4181-a2df-14fb8ba53fa8 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:10.297097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:10.297695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:10.297966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:10.298228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:10.308044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:10.309486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:10.318731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1173/2333] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:10.608229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:10.609773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:10.622509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65bfff-938e-45fe-8a98-89081e0d8465 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:10.627883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:10.628522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:10.628823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:10.629095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] PATH_INFO: `/v3/projects/ee46f5e5f7c1495fb509cfa0e455866a` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:10.630318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee46f5e5f7c1495fb509cfa0e455866a)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:10.633480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:10.683710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee46f5e5f7c1495fb509cfa0e455866a', 'request_id': 'req-64c083b5-4088-4fd5-a690-8e048068c91e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.695847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee46f5e5f7c1495fb509cfa0e455866a', 'request_id': 'req-64c083b5-4088-4fd5-a690-8e048068c91e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.704296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee46f5e5f7c1495fb509cfa0e455866a', 'request_id': 'req-64c083b5-4088-4fd5-a690-8e048068c91e'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.718968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] The token cache is being invalidate because project ee46f5e5f7c1495fb509cfa0e455866a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:10.719260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.719999 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.721709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1161/2334] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:10 2022] DELETE /identity/v3/projects/ee46f5e5f7c1495fb509cfa0e455866a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:10.725972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:10.735789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7de1c7-65b0-4df6-ab26-60804be4077d service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:10.792428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:10.793058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:10.793330 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:10.793621 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] PATH_INFO: `/v3/users/2196542c92be4f7e8707da057391ec17` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:10.794748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2196542c92be4f7e8707da057391ec17)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:10.796740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:10.852245 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2196542c92be4f7e8707da057391ec17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.862792 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2196542c92be4f7e8707da057391ec17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.863755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2196542c92be4f7e8707da057391ec17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.864651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2196542c92be4f7e8707da057391ec17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.875743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-22784e9d-01b4-45a1-bddb-773fcef6632d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2196542c92be4f7e8707da057391ec17'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:10.895679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1174/2335] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:10 2022] DELETE /identity/v3/users/2196542c92be4f7e8707da057391ec17 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:11.188583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.190093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:11.203578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c083b5-4088-4fd5-a690-8e048068c91e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:11.263407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:11.263965 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.264240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.264509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] PATH_INFO: `/v3/projects/37dc324d0f3341f8a096e7fccbe04db5` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.265640 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dc324d0f3341f8a096e7fccbe04db5)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:11.267578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:11.301897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:11.319342 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dc324d0f3341f8a096e7fccbe04db5', 'request_id': 'req-96fd8337-c41e-439c-8b3a-cc2b4996b217'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:11.329465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dc324d0f3341f8a096e7fccbe04db5', 'request_id': 'req-96fd8337-c41e-439c-8b3a-cc2b4996b217'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:11.336470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dc324d0f3341f8a096e7fccbe04db5', 'request_id': 'req-96fd8337-c41e-439c-8b3a-cc2b4996b217'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:11.348019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] The token cache is being invalidate because project 37dc324d0f3341f8a096e7fccbe04db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:11.348311 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:11.348991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-96fd8337-c41e-439c-8b3a-cc2b4996b217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:11.350483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1162/2336] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:11 2022] DELETE /identity/v3/projects/37dc324d0f3341f8a096e7fccbe04db5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:11.355500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2acdd0-0b9a-4850-a9ed-d9c920a23d11 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.355929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2acdd0-0b9a-4850-a9ed-d9c920a23d11 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.356061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2acdd0-0b9a-4850-a9ed-d9c920a23d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.378604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-fe2acdd0-0b9a-4850-a9ed-d9c920a23d11 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:11.380336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-fe2acdd0-0b9a-4850-a9ed-d9c920a23d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:11.433950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:11.450652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1175/2337] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:11.458737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6919c-aced-405b-b201-c6e0d02c6188 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.459062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6919c-aced-405b-b201-c6e0d02c6188 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.459334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6919c-aced-405b-b201-c6e0d02c6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.480323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-ebb6919c-aced-405b-b201-c6e0d02c6188 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:11.481530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ebb6919c-aced-405b-b201-c6e0d02c6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:11.490757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1163/2338] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:11.495264 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2acdd0-0b9a-4850-a9ed-d9c920a23d11 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.505516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2acdd0-0b9a-4850-a9ed-d9c920a23d11 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:11.510278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:11.510935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.511213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.511477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.512143 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:37:11.512437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:11.514149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:11.526111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1176/2339] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:37:11.531159 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6919c-aced-405b-b201-c6e0d02c6188 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.545378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6919c-aced-405b-b201-c6e0d02c6188 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:11.553188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:11.554033 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.554397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.554752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.555733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:11.558422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:11.596991 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1164/2340] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:11 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:11.601428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.611545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f046-329a-4668-ad64-c06509a26ab7 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:11.667094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:11.667689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.667957 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.668206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.668832 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:11.670745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:11.693586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1177/2341] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:11 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:11.697983 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.709218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f709-e579-469d-9855-695adbfec240 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:11.715149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:11.715804 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.716074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.716338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.716974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:11.718566 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:11.728892 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1165/2342] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:11.733247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.743394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b453f6-dba2-4c2d-b258-f924c4b08b4b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:11.748387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130a261-ea37-4c90-bfe8-78b9b6d87cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:11.748978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130a261-ea37-4c90-bfe8-78b9b6d87cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.749257 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130a261-ea37-4c90-bfe8-78b9b6d87cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.749528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130a261-ea37-4c90-bfe8-78b9b6d87cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.750164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130a261-ea37-4c90-bfe8-78b9b6d87cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:11.751844 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130a261-ea37-4c90-bfe8-78b9b6d87cc2 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:11.762302 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1178/2343] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:11.766576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.776680 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa51bf-1195-4c42-973c-c90d86651866 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:11.781810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:11.782449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.782723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.783022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] PATH_INFO: `/v3/projects/ee38605421b54eb49eca5e287915262b/users/45d7379cc0bd4ff2928963668637f5be/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.797813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee38605421b54eb49eca5e287915262b, user_id=45d7379cc0bd4ff2928963668637f5be, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:11.800461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:11.816268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1166/2344] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:11 2022] PUT /identity/v3/projects/ee38605421b54eb49eca5e287915262b/users/45d7379cc0bd4ff2928963668637f5be/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:11.826522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf2c03-da5b-405c-b760-4507874c9373 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:11.826800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf2c03-da5b-405c-b760-4507874c9373 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:11.827111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf2c03-da5b-405c-b760-4507874c9373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:11.856259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-0baf2c03-da5b-405c-b760-4507874c9373 None None] MFA Rules not processed for user `45d7379cc0bd4ff2928963668637f5be`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:11.857470 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0baf2c03-da5b-405c-b760-4507874c9373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:11.927922 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1179/2345] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:11.932765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:11.999428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dbc23-3d99-419e-b8f0-9d860745e3df admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.004667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.005275 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.005553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.005853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.006463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.008410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.043993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1167/2346] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:11 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:12.048348 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf2c03-da5b-405c-b760-4507874c9373 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.060419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf2c03-da5b-405c-b760-4507874c9373 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.104059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:12.122581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.123222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.123497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.123798 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.124441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.126359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.151380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1180/2347] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:12 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:12.155416 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.165534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b10b-5ec9-40ba-8137-c2ddc3842b42 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.170830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.171438 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.171712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.171979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.172614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.174197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.185709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1168/2348] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:12.189673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.200184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813ed9-fc1e-475e-a8f2-be2ba4fbb9e5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.206236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b569b4-607e-46c6-95e0-1823c51722f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.206865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b569b4-607e-46c6-95e0-1823c51722f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.207146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b569b4-607e-46c6-95e0-1823c51722f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.207413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b569b4-607e-46c6-95e0-1823c51722f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.208048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b569b4-607e-46c6-95e0-1823c51722f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.209704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b569b4-607e-46c6-95e0-1823c51722f5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.220275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1181/2349] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:12.226744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.241913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4436b-fd78-4574-b671-10b2767d38c4 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.248842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.249505 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.249782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.250086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] PATH_INFO: `/v3/projects/87d5ef6b8cdc4c33b7d2ad435e1b1648/users/28a52ecea60148cfa4ecf0012f7403ff/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.262981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:12.266233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d5ef6b8cdc4c33b7d2ad435e1b1648, user_id=28a52ecea60148cfa4ecf0012f7403ff, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.269224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.284014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1169/2350] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:12 2022] PUT /identity/v3/projects/87d5ef6b8cdc4c33b7d2ad435e1b1648/users/28a52ecea60148cfa4ecf0012f7403ff/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:12.295867 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6cd70-d948-4322-bb28-6aeda778cc67 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.296044 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6cd70-d948-4322-bb28-6aeda778cc67 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.296370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6cd70-d948-4322-bb28-6aeda778cc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.325153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d3e6cd70-d948-4322-bb28-6aeda778cc67 None None] MFA Rules not processed for user `28a52ecea60148cfa4ecf0012f7403ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:12.326357 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d3e6cd70-d948-4322-bb28-6aeda778cc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:12.393524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1182/2351] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:12.398200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.463691 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9b17d-7b00-44a1-8194-0b9e13da1f5f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.469023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.469629 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.469901 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.470175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.470791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.472726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.502081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1170/2352] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:12 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:12.506889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6cd70-d948-4322-bb28-6aeda778cc67 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.519156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6cd70-d948-4322-bb28-6aeda778cc67 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.575594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.576086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.576364 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.576626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.577246 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.579199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.605623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1183/2353] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:12 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:12.609827 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.620710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadcbe2-2b83-4a02-af2f-68526e57f409 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.625922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.626525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.626806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.627110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.627750 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.629386 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.640274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1171/2354] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:12.644610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.654843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d881-97a9-4041-a98a-2ac82a3c264d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.660462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.661111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.661384 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.661656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] PATH_INFO: `/v3/projects/86dd61ba502a4beaa8b9cc8695cd0b47/users/57dff77f5d714b3ab90741fec14bed56/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.677641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dd61ba502a4beaa8b9cc8695cd0b47, user_id=57dff77f5d714b3ab90741fec14bed56, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.680352 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.695033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1184/2355] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:12 2022] PUT /identity/v3/projects/86dd61ba502a4beaa8b9cc8695cd0b47/users/57dff77f5d714b3ab90741fec14bed56/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:12.699534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.709973 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273450-e775-46e1-b1a3-6f86aa81b2ff admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.768321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f42a-701c-4c71-a10b-fc9ca2e41351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.769148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f42a-701c-4c71-a10b-fc9ca2e41351 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.769469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f42a-701c-4c71-a10b-fc9ca2e41351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.769759 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f42a-701c-4c71-a10b-fc9ca2e41351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.770389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f42a-701c-4c71-a10b-fc9ca2e41351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.772157 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f42a-701c-4c71-a10b-fc9ca2e41351 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.781960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1172/2356] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:37:12.786504 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.797674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7c3df-6ae9-4662-9b8e-b75738f8287b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:12.803406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:12.804057 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.804334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.804608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] PATH_INFO: `/v3/projects/86dd61ba502a4beaa8b9cc8695cd0b47/users/57dff77f5d714b3ab90741fec14bed56/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.807314 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dd61ba502a4beaa8b9cc8695cd0b47, user_id=57dff77f5d714b3ab90741fec14bed56, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:12.809969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:12.820971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1185/2357] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:12 2022] PUT /identity/v3/projects/86dd61ba502a4beaa8b9cc8695cd0b47/users/57dff77f5d714b3ab90741fec14bed56/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:12.831741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:12.831916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:12.832234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:12.863527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] MFA Rules not processed for user `57dff77f5d714b3ab90741fec14bed56`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:12.864752 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:12.920331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:12.945515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1173/2358] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:12.958199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:12.961244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:12.969117 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:13.030254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1e5c6-1364-4018-ab39-fa08fe837486 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:13.034194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:13.034790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:13.035095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:13.035361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:13.047226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:13.048684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:13.058498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1186/2359] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:13.606132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:13.608588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:13.626942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a209-8699-40ac-8e30-cfa8c71c62ba None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:13.632030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:13.632693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:13.632975 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:13.633244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:13.699411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:13.700589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:13.710156 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1174/2360] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:17.858928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:17.868289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e472c34-f5e1-4700-9d10-b38a7bb9558b service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:17.872800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ff911-24ea-40fa-aa33-b37df1c7e6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:17.873398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff911-24ea-40fa-aa33-b37df1c7e6dd service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:17.873670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff911-24ea-40fa-aa33-b37df1c7e6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:17.873930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff911-24ea-40fa-aa33-b37df1c7e6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:17.934086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ff911-24ea-40fa-aa33-b37df1c7e6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:17.935935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ff911-24ea-40fa-aa33-b37df1c7e6dd service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:17.946486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1187/2361] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:20.111879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:20.176140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6681-3b2e-49ba-be89-6bdb5fa0b0ad service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:20.181552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:20.182186 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:20.182432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:20.182713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] PATH_INFO: `/v3/users/45d7379cc0bd4ff2928963668637f5be` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:20.183922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d7379cc0bd4ff2928963668637f5be)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:20.185821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:20.237695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d7379cc0bd4ff2928963668637f5be'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.244654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d7379cc0bd4ff2928963668637f5be'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.245321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d7379cc0bd4ff2928963668637f5be'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.245933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d7379cc0bd4ff2928963668637f5be'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.253774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d7379cc0bd4ff2928963668637f5be'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.271988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1175/2362] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:20 2022] DELETE /identity/v3/users/45d7379cc0bd4ff2928963668637f5be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:20.276809 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:20.277281 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:20.277389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:20.296657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:20.297781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:20.359485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1188/2363] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:20.369687 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:20.371249 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:20.378191 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:20.433469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc709db-86f2-479b-9a52-372eefff8d30 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:20.437638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:20.438284 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:20.438558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:20.438886 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:20.448504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:20.449957 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:20.460272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1176/2364] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:20.728041 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:20.729501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:20.741929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb99e0-8cb6-4c96-a8cc-c11fdada1314 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:20.748156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:20.748896 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:20.749165 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:20.749436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] PATH_INFO: `/v3/projects/ee38605421b54eb49eca5e287915262b` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:20.750782 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee38605421b54eb49eca5e287915262b)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:20.752816 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:20.802499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:20.809564 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee38605421b54eb49eca5e287915262b', 'request_id': 'req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.817789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee38605421b54eb49eca5e287915262b', 'request_id': 'req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.824524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee38605421b54eb49eca5e287915262b', 'request_id': 'req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.836877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] The token cache is being invalidate because project ee38605421b54eb49eca5e287915262b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:20.837167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.837843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.839461 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1189/2365] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:20 2022] DELETE /identity/v3/projects/ee38605421b54eb49eca5e287915262b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:37:20.844845 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:20.859543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ddf74-d5c4-4b31-b8e2-caae31270403 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:20.916469 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:20.917088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:20.917358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:20.917625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] PATH_INFO: `/v3/users/28a52ecea60148cfa4ecf0012f7403ff` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:20.918734 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a52ecea60148cfa4ecf0012f7403ff)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:20.920930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:20.969628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a52ecea60148cfa4ecf0012f7403ff'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.976532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a52ecea60148cfa4ecf0012f7403ff'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.977187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a52ecea60148cfa4ecf0012f7403ff'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.977783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a52ecea60148cfa4ecf0012f7403ff'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:20.986702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a52ecea60148cfa4ecf0012f7403ff'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.005873 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1177/2366] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:20 2022] DELETE /identity/v3/users/28a52ecea60148cfa4ecf0012f7403ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:21.293624 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:21.295290 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:21.309055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6536-8f7a-4392-9d56-3a065cb02c5b admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:21.367413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:21.367976 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:21.368251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:21.368517 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] PATH_INFO: `/v3/projects/87d5ef6b8cdc4c33b7d2ad435e1b1648` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:21.369623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d5ef6b8cdc4c33b7d2ad435e1b1648)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:21.371585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:21.417740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d5ef6b8cdc4c33b7d2ad435e1b1648', 'request_id': 'req-af91b08e-4793-4964-a0c6-a2e34082d9fe'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.426645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d5ef6b8cdc4c33b7d2ad435e1b1648', 'request_id': 'req-af91b08e-4793-4964-a0c6-a2e34082d9fe'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.433468 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d5ef6b8cdc4c33b7d2ad435e1b1648', 'request_id': 'req-af91b08e-4793-4964-a0c6-a2e34082d9fe'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.443671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] The token cache is being invalidate because project 87d5ef6b8cdc4c33b7d2ad435e1b1648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:21.443956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.444574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.446049 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1190/2367] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:21 2022] DELETE /identity/v3/projects/87d5ef6b8cdc4c33b7d2ad435e1b1648 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:21.450103 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:21.451609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:21.464905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996e7ba-7f10-4c66-ac5a-5570d48a530a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:21.489930 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:21.525288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:21.525919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:21.526192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:21.526507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] PATH_INFO: `/v3/users/57dff77f5d714b3ab90741fec14bed56` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:21.527907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57dff77f5d714b3ab90741fec14bed56)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:21.529903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:21.580550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57dff77f5d714b3ab90741fec14bed56'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.587658 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57dff77f5d714b3ab90741fec14bed56'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.588352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57dff77f5d714b3ab90741fec14bed56'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.588986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57dff77f5d714b3ab90741fec14bed56'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.598366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0e913bc8-0a8a-42d2-9a69-0487d648a11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57dff77f5d714b3ab90741fec14bed56'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:21.616094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1178/2368] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:21 2022] DELETE /identity/v3/users/57dff77f5d714b3ab90741fec14bed56 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:21.915037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:21.916612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:21.933729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91b08e-4793-4964-a0c6-a2e34082d9fe admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:21.994650 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:21.995325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:21.995597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:21.995865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] PATH_INFO: `/v3/projects/86dd61ba502a4beaa8b9cc8695cd0b47` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:21.997138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86dd61ba502a4beaa8b9cc8695cd0b47)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:21.999181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.000652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:22.050130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86dd61ba502a4beaa8b9cc8695cd0b47', 'request_id': 'req-f4c9ea28-00ea-441b-964b-4eeeeb920139'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:22.063035 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86dd61ba502a4beaa8b9cc8695cd0b47', 'request_id': 'req-f4c9ea28-00ea-441b-964b-4eeeeb920139'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:22.069495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86dd61ba502a4beaa8b9cc8695cd0b47', 'request_id': 'req-f4c9ea28-00ea-441b-964b-4eeeeb920139'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:22.079823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] The token cache is being invalidate because project 86dd61ba502a4beaa8b9cc8695cd0b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:22.080110 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:22.080735 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-f4c9ea28-00ea-441b-964b-4eeeeb920139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:22.082206 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1191/2369] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:21 2022] DELETE /identity/v3/projects/86dd61ba502a4beaa8b9cc8695cd0b47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:22.088237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9626b-82f0-40a1-b971-72569e887f28 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.088521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9626b-82f0-40a1-b971-72569e887f28 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.088792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9626b-82f0-40a1-b971-72569e887f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.109164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-76a9626b-82f0-40a1-b971-72569e887f28 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:22.110364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-76a9626b-82f0-40a1-b971-72569e887f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:22.170707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1179/2370] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:22.186215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1ed04-c1ca-4e92-a4da-f777c0350538 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.186863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1ed04-c1ca-4e92-a4da-f777c0350538 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.187401 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1ed04-c1ca-4e92-a4da-f777c0350538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.213099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-4ba1ed04-c1ca-4e92-a4da-f777c0350538 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:22.214310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-4ba1ed04-c1ca-4e92-a4da-f777c0350538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:22.223741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1192/2371] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:22.228264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9626b-82f0-40a1-b971-72569e887f28 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.238801 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9626b-82f0-40a1-b971-72569e887f28 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.244588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.245192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.245467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.245740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.246381 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:37:22.246690 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.248325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.260664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1180/2372] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:37:22.265088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1ed04-c1ca-4e92-a4da-f777c0350538 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.274445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1ed04-c1ca-4e92-a4da-f777c0350538 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.279700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.280365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.280659 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.280962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.281593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.283552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.317421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1193/2373] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:22 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:22.321871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.332644 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc333a-0379-4a0b-915c-67ff27168812 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.363784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:22.391925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.392534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.392809 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.393079 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.393704 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.395655 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.419188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1181/2374] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:22 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:22.423642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.434663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273da94-1099-48a2-94b7-2f0f6eeaab51 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.439463 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.440063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.440335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.440597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.441227 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.442885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.452865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1194/2375] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:22.457004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.466986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed5100-5174-4a0a-98f8-f5824f37d0e9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.471852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d59ef1-4c21-4e20-9064-8c119b059240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.472449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59ef1-4c21-4e20-9064-8c119b059240 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.472721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59ef1-4c21-4e20-9064-8c119b059240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.472986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59ef1-4c21-4e20-9064-8c119b059240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.473613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59ef1-4c21-4e20-9064-8c119b059240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.475299 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59ef1-4c21-4e20-9064-8c119b059240 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.485950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1182/2376] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:22.489994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.500306 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0591e-2e7f-4d15-8151-ce35714bf542 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.505365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.506033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.506400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.506679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] PATH_INFO: `/v3/projects/02f15f4345b84bad85b4ac85f6241234/users/14c010dc3fe64104baf572fb19530215/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.523610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f15f4345b84bad85b4ac85f6241234, user_id=14c010dc3fe64104baf572fb19530215, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.526265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.544682 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1195/2377] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:22 2022] PUT /identity/v3/projects/02f15f4345b84bad85b4ac85f6241234/users/14c010dc3fe64104baf572fb19530215/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:22.556606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e76af-3767-4148-9312-08632c583d2b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.556875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e76af-3767-4148-9312-08632c583d2b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.557187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e76af-3767-4148-9312-08632c583d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.586228 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-389e76af-3767-4148-9312-08632c583d2b None None] MFA Rules not processed for user `14c010dc3fe64104baf572fb19530215`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:22.587472 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-389e76af-3767-4148-9312-08632c583d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:22.663614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1183/2378] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:22.668365 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.734731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0c91-3e51-48ce-8803-2e15fb0435ff admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.740940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.741546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.741821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.742088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.742709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.744645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.775014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1196/2379] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:22 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:22.779666 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e76af-3767-4148-9312-08632c583d2b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.792245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e76af-3767-4148-9312-08632c583d2b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.852290 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.852895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.853174 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.853442 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.854075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.856011 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.877831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1184/2380] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:22 2022] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:22.882250 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.893200 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a9842-174a-4286-8284-7f9e3cfc2bfe admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.899120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.899724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.900001 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.900267 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.900902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.902516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.908051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:22.915321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1197/2381] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:37:22.918356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.929781 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae81ef-6f73-4ad0-acf0-310bbd13117f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:22.935166 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:22.935826 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:22.936104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:22.936430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] PATH_INFO: `/v3/projects/73bed7a229b4436f9301bbe4043381ec/users/1dab96cb222d40d4a1516385867aff52/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:22.952542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bed7a229b4436f9301bbe4043381ec, user_id=1dab96cb222d40d4a1516385867aff52, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:22.955160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:22.969799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1185/2382] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:22 2022] PUT /identity/v3/projects/73bed7a229b4436f9301bbe4043381ec/users/1dab96cb222d40d4a1516385867aff52/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:22.973920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:22.984611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274120c-0b8b-444e-8a90-45e8bc062cff admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:23.042626 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f3115-12cb-4789-9118-2440e79dafab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:23.043261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3115-12cb-4789-9118-2440e79dafab admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:23.043536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3115-12cb-4789-9118-2440e79dafab admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:23.043808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3115-12cb-4789-9118-2440e79dafab admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:23.044435 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f3115-12cb-4789-9118-2440e79dafab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:23.046106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f3115-12cb-4789-9118-2440e79dafab admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:23.056177 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1198/2383] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:23.060773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:23.071766 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2edff4-58e0-40de-b9fa-4c2ce8392b2c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:23.076581 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:23.077281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:23.077551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:23.077820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] PATH_INFO: `/v3/projects/73bed7a229b4436f9301bbe4043381ec/users/1dab96cb222d40d4a1516385867aff52/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:23.079782 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bed7a229b4436f9301bbe4043381ec, user_id=1dab96cb222d40d4a1516385867aff52, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:23.082413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:23.084670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:23.094471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1186/2384] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:23 2022] PUT /identity/v3/projects/73bed7a229b4436f9301bbe4043381ec/users/1dab96cb222d40d4a1516385867aff52/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:23.104747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afbc2-e147-4707-ad7a-fa0642a71711 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:23.105026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afbc2-e147-4707-ad7a-fa0642a71711 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:23.105294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afbc2-e147-4707-ad7a-fa0642a71711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:23.133229 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ce1afbc2-e147-4707-ad7a-fa0642a71711 None None] MFA Rules not processed for user `1dab96cb222d40d4a1516385867aff52`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:23.134533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ce1afbc2-e147-4707-ad7a-fa0642a71711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:23.206906 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1199/2385] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:23.218146 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:23.220227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:23.279569 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d836-2a36-496b-bd2d-f4684a59e283 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:23.284356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:23.284988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:23.285267 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:23.285555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:23.295707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:23.297218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:23.307496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1187/2386] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:23 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:23.386647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1afbc2-e147-4707-ad7a-fa0642a71711 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:23.396954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1afbc2-e147-4707-ad7a-fa0642a71711 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:23.401145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18513e-71a6-4106-b040-6374d7bdad75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:23.401743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18513e-71a6-4106-b040-6374d7bdad75 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:23.402024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18513e-71a6-4106-b040-6374d7bdad75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:23.402337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18513e-71a6-4106-b040-6374d7bdad75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:23.473091 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18513e-71a6-4106-b040-6374d7bdad75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:23.474556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18513e-71a6-4106-b040-6374d7bdad75 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:23.483697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1200/2387] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:27.628802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:27.698149 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f7675-d0b8-4382-acf2-86426f5042f0 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:27.703005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:27.703649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:27.703921 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:27.704189 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] PATH_INFO: `/v3/users/14c010dc3fe64104baf572fb19530215` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:27.705358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c010dc3fe64104baf572fb19530215)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:27.707332 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:27.759302 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c010dc3fe64104baf572fb19530215'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:27.766183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c010dc3fe64104baf572fb19530215'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:27.766993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c010dc3fe64104baf572fb19530215'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:27.767679 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c010dc3fe64104baf572fb19530215'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:27.777543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c010dc3fe64104baf572fb19530215'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:27.795216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1188/2388] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:27 2022] DELETE /identity/v3/users/14c010dc3fe64104baf572fb19530215 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:27.800232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:27.800728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:27.800843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:27.821681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:27.822958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:27.838132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:27.886994 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1201/2389] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:27.896979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:27.898518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:27.917211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:27.957480 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5fe3-8580-4f75-8f00-ca672ca5b4fa admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:27.961274 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:27.961875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:27.962145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:27.962411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:27.971913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:27.973334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:27.982955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1189/2390] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:28.261584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:28.263239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:28.276516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429324-11e8-4de5-b067-d2e188c0df28 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:28.282448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:28.283191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:28.283478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:28.283741 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] PATH_INFO: `/v3/projects/02f15f4345b84bad85b4ac85f6241234` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:28.284988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f15f4345b84bad85b4ac85f6241234)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:28.286979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:28.337439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f15f4345b84bad85b4ac85f6241234', 'request_id': 'req-2939e59f-e7f2-4963-9ba0-11686d6622f4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.347344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f15f4345b84bad85b4ac85f6241234', 'request_id': 'req-2939e59f-e7f2-4963-9ba0-11686d6622f4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.354094 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f15f4345b84bad85b4ac85f6241234', 'request_id': 'req-2939e59f-e7f2-4963-9ba0-11686d6622f4'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.366190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] The token cache is being invalidate because project 02f15f4345b84bad85b4ac85f6241234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:28.366476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.367190 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.368752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1202/2391] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:28 2022] DELETE /identity/v3/projects/02f15f4345b84bad85b4ac85f6241234 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:28.373369 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:28.388466 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b817277-4d5a-487a-92ed-0eac8f81ff19 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:28.448172 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:28.448814 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:28.449091 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:28.449363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] PATH_INFO: `/v3/users/1dab96cb222d40d4a1516385867aff52` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:28.450562 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dab96cb222d40d4a1516385867aff52)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:28.452521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:28.498916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dab96cb222d40d4a1516385867aff52'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.505971 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dab96cb222d40d4a1516385867aff52'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.506743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dab96cb222d40d4a1516385867aff52'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.507439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dab96cb222d40d4a1516385867aff52'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.517041 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-66bf79e3-6f29-4b31-9356-ef9ede08944f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dab96cb222d40d4a1516385867aff52'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.535263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1190/2392] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:28 2022] DELETE /identity/v3/users/1dab96cb222d40d4a1516385867aff52 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:28.823835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:28.825603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:28.840213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e59f-e7f2-4963-9ba0-11686d6622f4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:28.912877 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:28.913443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:28.913756 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:28.914027 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] PATH_INFO: `/v3/projects/73bed7a229b4436f9301bbe4043381ec` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:28.915343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bed7a229b4436f9301bbe4043381ec)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:28.917291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:28.965198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:28.968285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bed7a229b4436f9301bbe4043381ec', 'request_id': 'req-642db584-4c2a-4a31-ad81-dd18498c8d22'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.977100 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bed7a229b4436f9301bbe4043381ec', 'request_id': 'req-642db584-4c2a-4a31-ad81-dd18498c8d22'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.983881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bed7a229b4436f9301bbe4043381ec', 'request_id': 'req-642db584-4c2a-4a31-ad81-dd18498c8d22'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.995841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] The token cache is being invalidate because project 73bed7a229b4436f9301bbe4043381ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:28.996148 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.996788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-642db584-4c2a-4a31-ad81-dd18498c8d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:28.998285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1203/2393] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:28 2022] DELETE /identity/v3/projects/73bed7a229b4436f9301bbe4043381ec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:29.003648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a312b-868d-4151-9274-e7e58431dc47 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.004173 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a312b-868d-4151-9274-e7e58431dc47 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.004406 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a312b-868d-4151-9274-e7e58431dc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.027282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1f9a312b-868d-4151-9274-e7e58431dc47 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:29.028479 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1f9a312b-868d-4151-9274-e7e58431dc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:29.064066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:29.092496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1191/2394] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:29.159376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ccc5-17a7-4d0d-b59c-2249403fc0ab None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.159671 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ccc5-17a7-4d0d-b59c-2249403fc0ab None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.159915 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ccc5-17a7-4d0d-b59c-2249403fc0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.182410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-7415ccc5-17a7-4d0d-b59c-2249403fc0ab None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:29.183579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7415ccc5-17a7-4d0d-b59c-2249403fc0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:29.192583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1204/2395] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:29.197678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a312b-868d-4151-9274-e7e58431dc47 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.210426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a312b-868d-4151-9274-e7e58431dc47 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.216351 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.216959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.217217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.217496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.218133 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:37:29.218433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.220239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.232414 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1192/2396] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:37:29.239079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415ccc5-17a7-4d0d-b59c-2249403fc0ab None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.251427 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415ccc5-17a7-4d0d-b59c-2249403fc0ab None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.258167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.258760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.259062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.259320 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.259950 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.261846 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.300440 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1205/2397] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:29 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:29.305762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.319589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03add47-d7e5-402b-b68b-942c78425b34 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.380410 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.381025 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.381305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.381579 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.382208 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.384196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.407376 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1193/2398] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:29 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:29.411662 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.422393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f1793-b1f0-4b9a-832f-75a805ac9536 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.428307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.428908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.429187 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.429459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.430073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.431722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.442611 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1206/2399] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:29.447350 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.464313 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39829-a8df-4013-a5e4-c2416d8002ab admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.472558 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486b06e-bea3-4d56-8101-4cd87da63c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.473160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b06e-bea3-4d56-8101-4cd87da63c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.473430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b06e-bea3-4d56-8101-4cd87da63c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.473692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b06e-bea3-4d56-8101-4cd87da63c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.474331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486b06e-bea3-4d56-8101-4cd87da63c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.475958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486b06e-bea3-4d56-8101-4cd87da63c08 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.488070 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1194/2400] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:37:29.492619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.503637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267663b5-1512-4b6e-b506-5274231747c9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.509256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.510033 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.510312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.510606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] PATH_INFO: `/v3/projects/244af17f255b462798a8985402e042fc/users/ae7153622216435598d04ccc1f35557f/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.526991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=244af17f255b462798a8985402e042fc, user_id=ae7153622216435598d04ccc1f35557f, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.529657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.544766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1207/2401] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:29 2022] PUT /identity/v3/projects/244af17f255b462798a8985402e042fc/users/ae7153622216435598d04ccc1f35557f/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:29.556012 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d83af-a58a-4699-b4d9-c745163a0e21 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.556288 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d83af-a58a-4699-b4d9-c745163a0e21 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.556555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d83af-a58a-4699-b4d9-c745163a0e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.587341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-330d83af-a58a-4699-b4d9-c745163a0e21 None None] MFA Rules not processed for user `ae7153622216435598d04ccc1f35557f`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:29.588550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-330d83af-a58a-4699-b4d9-c745163a0e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:29.656753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1195/2402] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:29.661766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.725589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c4b7-851c-4c6f-8310-462e306901ea admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.731242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.731841 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.732114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.732382 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.732995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.735077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.763687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1208/2403] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:29 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:29.768063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d83af-a58a-4699-b4d9-c745163a0e21 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.778627 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d83af-a58a-4699-b4d9-c745163a0e21 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.809357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:29.838071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.838683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.838963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.839269 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.839925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.841847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.866871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1196/2404] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:29 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:29.872505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.883025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c155e9-5314-4e3f-ab90-e0977a725b03 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.888074 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.888670 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.888946 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.889213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.889843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.891725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.902358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1209/2405] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:29.906538 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.916777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d400-3828-4cc4-9725-47c9a818c4ac admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:29.921798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:29.922505 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:29.922800 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:29.923125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] PATH_INFO: `/v3/projects/a69e420046b34e8388612987bb76cc60/users/f46b5f3c5716469caf18ec403bc0e547/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:29.938260 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69e420046b34e8388612987bb76cc60, user_id=f46b5f3c5716469caf18ec403bc0e547, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:29.940924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:29.956502 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1197/2406] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:29 2022] PUT /identity/v3/projects/a69e420046b34e8388612987bb76cc60/users/f46b5f3c5716469caf18ec403bc0e547/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:29.960588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:29.971173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7f83-3d87-454f-82d4-e7135da455de admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:30.012485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:30.028555 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa861f0-ad7b-4406-a56d-fece2d9ad7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:30.029199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa861f0-ad7b-4406-a56d-fece2d9ad7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:30.029472 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa861f0-ad7b-4406-a56d-fece2d9ad7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:30.029742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa861f0-ad7b-4406-a56d-fece2d9ad7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:30.030400 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa861f0-ad7b-4406-a56d-fece2d9ad7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:30.032168 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa861f0-ad7b-4406-a56d-fece2d9ad7f8 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:30.042361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1210/2407] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:30.046878 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:30.058196 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bff6b-5bee-4f29-985d-ca94ea43de32 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:30.063570 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:30.064292 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:30.064584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:30.064899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] PATH_INFO: `/v3/projects/a69e420046b34e8388612987bb76cc60/users/f46b5f3c5716469caf18ec403bc0e547/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:30.067168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69e420046b34e8388612987bb76cc60, user_id=f46b5f3c5716469caf18ec403bc0e547, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:30.069788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:30.080420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1198/2408] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:30 2022] PUT /identity/v3/projects/a69e420046b34e8388612987bb76cc60/users/f46b5f3c5716469caf18ec403bc0e547/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:30.090757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:30.091082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:30.091350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:30.121753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] MFA Rules not processed for user `f46b5f3c5716469caf18ec403bc0e547`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:30.123036 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:30.207050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1211/2409] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:30.220337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:30.222551 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:30.282233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f737-6032-4596-994d-323cd069ee2a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:30.286377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:30.287030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:30.287276 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:30.287584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:30.348481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:30.349925 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:30.359235 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1199/2410] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:32.896920 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:32.898623 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:32.912592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a132084-e20d-40c0-af06-1bd1d5564ea3 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:32.917397 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f686582-fa59-449a-b7ef-474834f46736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:32.918029 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686582-fa59-449a-b7ef-474834f46736 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:32.918321 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686582-fa59-449a-b7ef-474834f46736 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:32.918590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686582-fa59-449a-b7ef-474834f46736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:32.920604 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-7f686582-fa59-449a-b7ef-474834f46736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:32.927076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:32.972379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:32.993483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6ef0a-c98b-4f13-afcd-b1342232ea15 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:32.997092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f686582-fa59-449a-b7ef-474834f46736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:32.998597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f686582-fa59-449a-b7ef-474834f46736 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:32.999067 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:32.999794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:33.000130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:33.000402 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] PATH_INFO: `/v3/users/ae7153622216435598d04ccc1f35557f` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:33.001550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7153622216435598d04ccc1f35557f)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:33.003508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:33.009800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1212/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:33.055720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7153622216435598d04ccc1f35557f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.063577 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7153622216435598d04ccc1f35557f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.064293 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7153622216435598d04ccc1f35557f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.064931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7153622216435598d04ccc1f35557f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.072993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7153622216435598d04ccc1f35557f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.091986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1200/2412] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:32 2022] DELETE /identity/v3/users/ae7153622216435598d04ccc1f35557f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:37:33.097002 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:33.097310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:33.097668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:33.117588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:33.118786 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:33.165974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:33.183065 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1213/2413] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:37:33.193988 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:33.195779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:33.266670 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae50131-90a3-4946-8e42-f3ec2ac1b703 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:33.271046 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:33.271669 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:33.272050 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:33.272340 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:33.282448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:33.284071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:33.294397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1201/2414] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:33.581341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:33.583111 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:33.596072 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1bc5e-f824-4436-8400-1185c8c8bb56 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:33.602293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:33.602993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:33.603247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:33.603526 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] PATH_INFO: `/v3/projects/244af17f255b462798a8985402e042fc` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:33.604854 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=244af17f255b462798a8985402e042fc)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:33.606845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:33.657913 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244af17f255b462798a8985402e042fc', 'request_id': 'req-aeef7108-a5ff-48c8-9e67-d6653f64b04e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.666211 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244af17f255b462798a8985402e042fc', 'request_id': 'req-aeef7108-a5ff-48c8-9e67-d6653f64b04e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.672810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244af17f255b462798a8985402e042fc', 'request_id': 'req-aeef7108-a5ff-48c8-9e67-d6653f64b04e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.683796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] The token cache is being invalidate because project 244af17f255b462798a8985402e042fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:33.684077 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.684724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.686270 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1214/2415] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:33 2022] DELETE /identity/v3/projects/244af17f255b462798a8985402e042fc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:33.690634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:33.700611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0a035-a33e-43dc-8714-c97a6c260eec service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:33.761639 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:33.762194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:33.762474 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:33.762744 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] PATH_INFO: `/v3/users/f46b5f3c5716469caf18ec403bc0e547` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:33.763952 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46b5f3c5716469caf18ec403bc0e547)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:33.765898 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:33.768324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:33.820154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46b5f3c5716469caf18ec403bc0e547'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.828359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46b5f3c5716469caf18ec403bc0e547'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.829074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46b5f3c5716469caf18ec403bc0e547'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.829720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46b5f3c5716469caf18ec403bc0e547'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.839725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-32176d72-23b2-4795-8001-94bcc203ca47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46b5f3c5716469caf18ec403bc0e547'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:33.859229 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1202/2416] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:33 2022] DELETE /identity/v3/users/f46b5f3c5716469caf18ec403bc0e547 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:34.151090 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.152583 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:34.167758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7108-a5ff-48c8-9e67-d6653f64b04e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.226276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.226940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.227219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.227483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] PATH_INFO: `/v3/projects/a69e420046b34e8388612987bb76cc60` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.228598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69e420046b34e8388612987bb76cc60)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.230544 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:34.280465 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69e420046b34e8388612987bb76cc60', 'request_id': 'req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:34.288184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69e420046b34e8388612987bb76cc60', 'request_id': 'req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:34.294974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69e420046b34e8388612987bb76cc60', 'request_id': 'req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:34.307086 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] The token cache is being invalidate because project a69e420046b34e8388612987bb76cc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:34.307376 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:34.308064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-1cdaaa5e-cb4c-4f5d-959e-1bfdbbf9226e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:34.313140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1215/2417] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:34 2022] DELETE /identity/v3/projects/a69e420046b34e8388612987bb76cc60 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:34.314725 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898403e-8ecb-423f-8d1d-3fa728c78762 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.315509 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898403e-8ecb-423f-8d1d-3fa728c78762 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.315772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898403e-8ecb-423f-8d1d-3fa728c78762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.347072 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6898403e-8ecb-423f-8d1d-3fa728c78762 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:34.348425 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6898403e-8ecb-423f-8d1d-3fa728c78762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:34.412197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1203/2418] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:37:34.420640 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cdfc-814b-4072-8281-36264b49e8cd None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.420958 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cdfc-814b-4072-8281-36264b49e8cd None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.421387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cdfc-814b-4072-8281-36264b49e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.432586 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:34.444938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-aa59cdfc-814b-4072-8281-36264b49e8cd None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:34.446664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-aa59cdfc-814b-4072-8281-36264b49e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:34.455674 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1216/2419] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:34.460176 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898403e-8ecb-423f-8d1d-3fa728c78762 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.470282 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898403e-8ecb-423f-8d1d-3fa728c78762 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.475436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30975295-4909-4594-9773-e7439af9633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.476083 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975295-4909-4594-9773-e7439af9633e admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.476363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975295-4909-4594-9773-e7439af9633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.476613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975295-4909-4594-9773-e7439af9633e admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.477259 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30975295-4909-4594-9773-e7439af9633e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:37:34.477554 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30975295-4909-4594-9773-e7439af9633e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.479211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30975295-4909-4594-9773-e7439af9633e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:34.491169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1204/2420] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:37:34.495654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cdfc-814b-4072-8281-36264b49e8cd None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.505215 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cdfc-814b-4072-8281-36264b49e8cd None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.510180 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.510783 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.511088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.511361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.511995 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.513904 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:34.543318 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1217/2421] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:34 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:34.549405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30975295-4909-4594-9773-e7439af9633e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.562665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30975295-4909-4594-9773-e7439af9633e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.624854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.625465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.625742 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.626009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.626638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.628696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:34.645822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:34.652754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1205/2422] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:34 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:34.657093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.667692 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c965-9c5e-4739-b487-59b30b1101e0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.672784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.673434 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.673709 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.673979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.674642 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.676362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:34.687101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1218/2423] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:34.691238 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.702104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d62ee-6000-4e98-bb46-6d3b2d8dbea8 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.708308 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c732ac-c3a6-40cd-9ff8-d62645365e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.708959 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c732ac-c3a6-40cd-9ff8-d62645365e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.709244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c732ac-c3a6-40cd-9ff8-d62645365e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.709497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c732ac-c3a6-40cd-9ff8-d62645365e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.710227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c732ac-c3a6-40cd-9ff8-d62645365e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.711796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c732ac-c3a6-40cd-9ff8-d62645365e14 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:34.723494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1206/2424] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:34.728778 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.745356 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa32faa-ebb0-4483-8cad-487f7f99b40f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.754760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.755577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.755857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.756125 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] PATH_INFO: `/v3/projects/c60de69cf520439b80703c8130611b3c/users/bf74fcd0d0574976986155c7d6f73ff3/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.772557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60de69cf520439b80703c8130611b3c, user_id=bf74fcd0d0574976986155c7d6f73ff3, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.775345 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:34.792373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1219/2425] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:34 2022] PUT /identity/v3/projects/c60de69cf520439b80703c8130611b3c/users/bf74fcd0d0574976986155c7d6f73ff3/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:34.803590 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22846712-b6a2-45e2-bdf2-bbb4b9fd6ca4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.803822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22846712-b6a2-45e2-bdf2-bbb4b9fd6ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.804099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22846712-b6a2-45e2-bdf2-bbb4b9fd6ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.834881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-22846712-b6a2-45e2-bdf2-bbb4b9fd6ca4 None None] MFA Rules not processed for user `bf74fcd0d0574976986155c7d6f73ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:34.836081 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-22846712-b6a2-45e2-bdf2-bbb4b9fd6ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:34.908896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1207/2426] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:34.919911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:34.921777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:34.980916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0684b06-106a-4de8-8dfa-4415e69c4942 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:34.985335 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:34.985966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:34.986266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:34.986520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:34.998515 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:34.999997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:35.009113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1220/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:36.798356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e108cf-0305-462d-9030-6318baa5da33 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:36.798911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e108cf-0305-462d-9030-6318baa5da33 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:36.798911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e108cf-0305-462d-9030-6318baa5da33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:36.819310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-d6e108cf-0305-462d-9030-6318baa5da33 None None] MFA Rules not processed for user `18c2669e28e24bb29a8e57d45dfd3270`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:36.820490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d6e108cf-0305-462d-9030-6318baa5da33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:36.875839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1208/2428] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:37.528308 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:37.529928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:37.589717 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea41aa-286f-4cae-a414-30c075622c96 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:37.593402 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3060c-b924-41cf-9a11-9214fde5257f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:37.594017 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3060c-b924-41cf-9a11-9214fde5257f service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:37.594293 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3060c-b924-41cf-9a11-9214fde5257f service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:37.594563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3060c-b924-41cf-9a11-9214fde5257f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:37.596422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-98b3060c-b924-41cf-9a11-9214fde5257f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:37.653755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:37.671900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3060c-b924-41cf-9a11-9214fde5257f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:37.673355 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3060c-b924-41cf-9a11-9214fde5257f service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:37.684949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1221/2429] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:38.065511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e108cf-0305-462d-9030-6318baa5da33 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:38.137853 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e108cf-0305-462d-9030-6318baa5da33 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:38.142967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:38.143616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:38.143891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:38.144324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] PATH_INFO: `/v3/users/bf74fcd0d0574976986155c7d6f73ff3` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:38.145774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf74fcd0d0574976986155c7d6f73ff3)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:38.147783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:38.172043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:38.199609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf74fcd0d0574976986155c7d6f73ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.206532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf74fcd0d0574976986155c7d6f73ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.207240 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf74fcd0d0574976986155c7d6f73ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.207879 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf74fcd0d0574976986155c7d6f73ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.216668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf74fcd0d0574976986155c7d6f73ff3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.235401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1209/2430] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:38 2022] DELETE /identity/v3/users/bf74fcd0d0574976986155c7d6f73ff3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:38.240140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:38.240426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:38.240734 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:38.261307 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:38.262417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:38.335134 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1222/2431] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:38.348589 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:38.350102 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:38.412624 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fffd-bd87-41d1-ad7f-8ff1ca687416 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:38.416978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c8eca-7b0c-4463-9f17-cdad6d2102aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:38.417580 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c8eca-7b0c-4463-9f17-cdad6d2102aa service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:38.417860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c8eca-7b0c-4463-9f17-cdad6d2102aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:38.418135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c8eca-7b0c-4463-9f17-cdad6d2102aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:38.428707 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c8eca-7b0c-4463-9f17-cdad6d2102aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:38.430143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c8eca-7b0c-4463-9f17-cdad6d2102aa service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:38.439939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1210/2432] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:38.733897 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:38.735420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:38.751019 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1c0d-0c4b-4de3-a970-f0e70a9034a4 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:38.756845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:38.767278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:38.767584 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:38.767862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] PATH_INFO: `/v3/projects/c60de69cf520439b80703c8130611b3c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:38.771598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60de69cf520439b80703c8130611b3c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:38.774672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:38.835062 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60de69cf520439b80703c8130611b3c', 'request_id': 'req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.844718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60de69cf520439b80703c8130611b3c', 'request_id': 'req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.852226 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60de69cf520439b80703c8130611b3c', 'request_id': 'req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.863322 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] The token cache is being invalidate because project c60de69cf520439b80703c8130611b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:38.863825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.864546 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ba85f6ec-5035-4ebc-84e0-7bc7cd1f6330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:38.866332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1223/2433] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:38 2022] DELETE /identity/v3/projects/c60de69cf520439b80703c8130611b3c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:38.871817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81398a-3f33-425d-adaa-1d8ba3381e47 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:38.872428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81398a-3f33-425d-adaa-1d8ba3381e47 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:38.872795 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81398a-3f33-425d-adaa-1d8ba3381e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:38.894885 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-7a81398a-3f33-425d-adaa-1d8ba3381e47 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:38.896378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-7a81398a-3f33-425d-adaa-1d8ba3381e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:38.958432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1211/2434] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:38.967414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948646c-2461-4454-bab5-d42b017332a5 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:38.967761 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948646c-2461-4454-bab5-d42b017332a5 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:38.968113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948646c-2461-4454-bab5-d42b017332a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:38.990419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-6948646c-2461-4454-bab5-d42b017332a5 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:38.991679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-6948646c-2461-4454-bab5-d42b017332a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:39.000043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1224/2435] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:39.004264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81398a-3f33-425d-adaa-1d8ba3381e47 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.014528 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81398a-3f33-425d-adaa-1d8ba3381e47 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.019664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.020513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.020939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.021234 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.021888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:37:39.022192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.023831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.041702 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1212/2436] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:37:39.042905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948646c-2461-4454-bab5-d42b017332a5 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.052753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948646c-2461-4454-bab5-d42b017332a5 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.058407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.059078 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.059354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.059614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.060248 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.062147 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.090622 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1225/2437] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:39 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:39.094763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.105120 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb8a5-7b6e-4e20-aea3-4bf81c131d4a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.134963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:39.167849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.168467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.168745 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.169014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.169681 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.171675 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.194483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1213/2438] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:39 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:39.198728 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.209421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191f9f2-7746-4d1b-bbdd-1376aa0574ba admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.214093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.214745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.215035 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.215303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.215938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.217552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.228612 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1226/2439] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:39.232773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.244557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493df287-7c5b-403d-94f4-ad851055ba5d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.249545 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca32d60-1d18-45aa-9716-8143ea501c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.250271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32d60-1d18-45aa-9716-8143ea501c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.250612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32d60-1d18-45aa-9716-8143ea501c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.251088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca32d60-1d18-45aa-9716-8143ea501c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.251905 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca32d60-1d18-45aa-9716-8143ea501c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.253802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca32d60-1d18-45aa-9716-8143ea501c17 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.269200 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1214/2440] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:39.271619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.282276 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527d39-1501-4470-bb0f-e8f91b861e35 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.287522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.288209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.288486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.288754 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] PATH_INFO: `/v3/projects/da764e69b07d444d960dfc22f550d4de/users/0fa437c1529646ca91575006f915cba3/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.305637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=da764e69b07d444d960dfc22f550d4de, user_id=0fa437c1529646ca91575006f915cba3, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.308390 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.329981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1227/2441] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:39 2022] PUT /identity/v3/projects/da764e69b07d444d960dfc22f550d4de/users/0fa437c1529646ca91575006f915cba3/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:39.341749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b0c2-481a-4f57-8850-c6288b20f248 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.341967 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b0c2-481a-4f57-8850-c6288b20f248 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.342237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b0c2-481a-4f57-8850-c6288b20f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.350706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.352607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:39.359984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:39.375097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1d26b0c2-481a-4f57-8850-c6288b20f248 None None] MFA Rules not processed for user `0fa437c1529646ca91575006f915cba3`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:39.376648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1d26b0c2-481a-4f57-8850-c6288b20f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:39.424819 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271091-4ee6-44d3-b781-e4938f0803ff admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.429193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.429814 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.430088 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.430350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.432292 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:39.443096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.444702 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.448796 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1215/2442] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:39.453246 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26b0c2-481a-4f57-8850-c6288b20f248 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.456631 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1228/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 13:37:39.520860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26b0c2-481a-4f57-8850-c6288b20f248 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.525460 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.526088 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.526364 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.526634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.527301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.529253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.562413 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1216/2444] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:39 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:39.563645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.576999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b229b6-2111-4e0e-8703-28009d9043b9 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.635933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.636473 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.636752 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.637020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.637655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.639684 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.665265 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1229/2445] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:39 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:39.669449 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.681074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05929286-b773-40d8-a70e-728c547c1b63 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.685968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.686625 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.686942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.687216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.687894 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.689499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.703179 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1217/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:39.704561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.715105 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677858d-38e7-4ac3-a188-ccad5163bf56 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.719808 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c10fd-fd3d-42e3-85a3-ff80795cf80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.720489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c10fd-fd3d-42e3-85a3-ff80795cf80f admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.720833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c10fd-fd3d-42e3-85a3-ff80795cf80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.721171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c10fd-fd3d-42e3-85a3-ff80795cf80f admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.721876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c10fd-fd3d-42e3-85a3-ff80795cf80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.724010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c10fd-fd3d-42e3-85a3-ff80795cf80f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.734159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1230/2447] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:39.738422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.749426 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea28ea-7533-4eee-aa26-9f25ce2c84aa admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.754883 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.755611 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.755875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.756162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] PATH_INFO: `/v3/projects/ca4cbda214924dae9c641f17895120d5/users/8b612acc67c245589102c1800806c3fc/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.768737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:39.773164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4cbda214924dae9c641f17895120d5, user_id=8b612acc67c245589102c1800806c3fc, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:39.776780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:39.792325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1218/2448] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:39 2022] PUT /identity/v3/projects/ca4cbda214924dae9c641f17895120d5/users/8b612acc67c245589102c1800806c3fc/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:39.803514 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c0ad-fdb2-464f-9aad-e98d3d7a3e60 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.803802 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c0ad-fdb2-464f-9aad-e98d3d7a3e60 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.804073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c0ad-fdb2-464f-9aad-e98d3d7a3e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:39.834510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-f2a0c0ad-fdb2-464f-9aad-e98d3d7a3e60 None None] MFA Rules not processed for user `8b612acc67c245589102c1800806c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:39.835545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-f2a0c0ad-fdb2-464f-9aad-e98d3d7a3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:39.915154 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1231/2449] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:37:39.919488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:39.994168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b1228-b1d6-496e-8062-3c7fbcddedba admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:39.998751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:39.999427 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:39.999722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:39.999979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.000756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:40.002689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:40.037066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1219/2450] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:37:39 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:37:40.038300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c0ad-fdb2-464f-9aad-e98d3d7a3e60 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:40.049981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c0ad-fdb2-464f-9aad-e98d3d7a3e60 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:40.062361 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:40.109571 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:40.110191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:40.110520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:40.110722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.111398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:40.113325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:40.139209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1232/2451] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:37:40 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:37:40.143648 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:40.155960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a523b2-f13e-4d99-aba3-8d206f9623be admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:40.162086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:40.162529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:40.162943 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:40.163106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.163757 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:40.165847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:40.190849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1220/2452] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:37:40.192183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:40.202460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49a398-07a3-48ca-bae9-3c7f32879cd9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:40.209171 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:40.209852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:40.210130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:40.210406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] PATH_INFO: `/v3/projects/4c0efd9e2ca049bea1e50854dcd985e7/users/ba4bf38b33364f8bb6ace3bb81a592d9/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.226220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0efd9e2ca049bea1e50854dcd985e7, user_id=ba4bf38b33364f8bb6ace3bb81a592d9, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:40.228982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:40.244963 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1233/2453] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:40 2022] PUT /identity/v3/projects/4c0efd9e2ca049bea1e50854dcd985e7/users/ba4bf38b33364f8bb6ace3bb81a592d9/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:37:40.249252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:40.259686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d0f1-8a92-4ba5-9e4c-be958cf07865 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:40.316535 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401df1-ed31-4968-b214-94f9367b504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:40.317160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401df1-ed31-4968-b214-94f9367b504f admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:40.317444 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401df1-ed31-4968-b214-94f9367b504f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:40.317710 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401df1-ed31-4968-b214-94f9367b504f admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.318353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e401df1-ed31-4968-b214-94f9367b504f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:40.319979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e401df1-ed31-4968-b214-94f9367b504f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:40.331019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1221/2454] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:37:40.335545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:40.347192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebd28f-0ae1-4764-b85c-b37b2c81941f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:40.351061 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:40.351723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:40.351993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:40.352261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] PATH_INFO: `/v3/projects/4c0efd9e2ca049bea1e50854dcd985e7/users/ba4bf38b33364f8bb6ace3bb81a592d9/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.354155 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0efd9e2ca049bea1e50854dcd985e7, user_id=ba4bf38b33364f8bb6ace3bb81a592d9, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:40.356796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:40.367956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1234/2455] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:37:40 2022] PUT /identity/v3/projects/4c0efd9e2ca049bea1e50854dcd985e7/users/ba4bf38b33364f8bb6ace3bb81a592d9/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:37:40.379405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:40.379692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:40.379963 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.409918 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] MFA Rules not processed for user `ba4bf38b33364f8bb6ace3bb81a592d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:40.411144 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:40.459358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:40.482922 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1222/2456] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:40.494230 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:40.496039 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:40.554852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cce376-f9cf-4d22-b7ef-a812b3b6635c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:40.558740 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:40.559377 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:40.559655 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:40.559921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:40.618085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:40.619579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:40.628459 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1235/2457] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:42.184610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:42.186119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:42.199667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae86466-0854-494a-a929-094f50de8f8b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:42.204597 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:42.205211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:42.205483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:42.205756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:42.269018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:42.270491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:42.280634 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1223/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:42.831797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:42.840767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac89b-6be9-428d-800c-764863e07961 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:42.844499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf2c11-ff6c-4f9b-a537-c234224684eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:42.845107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf2c11-ff6c-4f9b-a537-c234224684eb service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:42.845388 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf2c11-ff6c-4f9b-a537-c234224684eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:42.845658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf2c11-ff6c-4f9b-a537-c234224684eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:42.854978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf2c11-ff6c-4f9b-a537-c234224684eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:42.856424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf2c11-ff6c-4f9b-a537-c234224684eb service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:42.866008 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1236/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:46.821418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:46.885909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0084-ac54-4074-9bee-a5b24415824f service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:46.890932 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:46.891559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:46.891830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:46.892099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] PATH_INFO: `/v3/users/0fa437c1529646ca91575006f915cba3` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:46.893251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa437c1529646ca91575006f915cba3)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:46.895216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:46.944877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa437c1529646ca91575006f915cba3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:46.951741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa437c1529646ca91575006f915cba3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:46.952422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa437c1529646ca91575006f915cba3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:46.953017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa437c1529646ca91575006f915cba3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:46.962048 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa437c1529646ca91575006f915cba3'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:46.979432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1224/2460] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:46 2022] DELETE /identity/v3/users/0fa437c1529646ca91575006f915cba3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:37:46.984212 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:46.984621 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:46.984753 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:47.005399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:37:47.006619 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:47.011334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:47.073863 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1237/2461] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:37:47.084522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:47.086121 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:47.092281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:47.166305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f514-9fdd-40e0-b84a-51046a16b961 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:47.170093 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:47.170728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:47.171039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:47.171305 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:47.181126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:47.182549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:47.193135 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1225/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:47.476101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:47.478172 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:47.495204 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc85a16-3ca1-4c3a-b839-95a4e69d2510 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:47.500944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:47.501602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:47.501805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:47.502108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] PATH_INFO: `/v3/projects/da764e69b07d444d960dfc22f550d4de` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:47.503278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da764e69b07d444d960dfc22f550d4de)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:47.505230 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:47.554487 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da764e69b07d444d960dfc22f550d4de', 'request_id': 'req-863626be-ca05-471e-8f2a-c7ebec1a87b3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.563142 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da764e69b07d444d960dfc22f550d4de', 'request_id': 'req-863626be-ca05-471e-8f2a-c7ebec1a87b3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.569621 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da764e69b07d444d960dfc22f550d4de', 'request_id': 'req-863626be-ca05-471e-8f2a-c7ebec1a87b3'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.580536 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] The token cache is being invalidate because project da764e69b07d444d960dfc22f550d4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:47.580823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.581511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.583064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1238/2463] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:47 2022] DELETE /identity/v3/projects/da764e69b07d444d960dfc22f550d4de => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:37:47.587487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:47.597458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4ca8-4d2e-4556-8a24-6128aabf0d53 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:47.655497 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:47.656143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:47.656419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:47.656689 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] PATH_INFO: `/v3/users/8b612acc67c245589102c1800806c3fc` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:47.657903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b612acc67c245589102c1800806c3fc)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:47.659992 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:47.709164 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b612acc67c245589102c1800806c3fc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.716407 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b612acc67c245589102c1800806c3fc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.717087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b612acc67c245589102c1800806c3fc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.717709 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b612acc67c245589102c1800806c3fc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.726004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b612acc67c245589102c1800806c3fc'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:47.744018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1226/2464] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:47 2022] DELETE /identity/v3/users/8b612acc67c245589102c1800806c3fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:48.027101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:48.028590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:48.042315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863626be-ca05-471e-8f2a-c7ebec1a87b3 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:48.102657 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:48.103343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:48.103615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:48.103885 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] PATH_INFO: `/v3/projects/ca4cbda214924dae9c641f17895120d5` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:48.105000 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4cbda214924dae9c641f17895120d5)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:48.106945 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:48.145375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:48.158698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4cbda214924dae9c641f17895120d5', 'request_id': 'req-e82c6de8-b462-483e-9191-7cafa419dc02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.166592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4cbda214924dae9c641f17895120d5', 'request_id': 'req-e82c6de8-b462-483e-9191-7cafa419dc02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.173047 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4cbda214924dae9c641f17895120d5', 'request_id': 'req-e82c6de8-b462-483e-9191-7cafa419dc02'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.184580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] The token cache is being invalidate because project ca4cbda214924dae9c641f17895120d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:48.184767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.185499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.187199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1239/2465] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:48 2022] DELETE /identity/v3/projects/ca4cbda214924dae9c641f17895120d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:37:48.191635 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:48.193134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:48.205830 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c508d-9061-429a-9660-909eaeef6811 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:48.226198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:48.266454 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:48.267145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:48.267419 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:48.267737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] PATH_INFO: `/v3/users/ba4bf38b33364f8bb6ace3bb81a592d9` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:48.269066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4bf38b33364f8bb6ace3bb81a592d9)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:48.270718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:48.325600 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4bf38b33364f8bb6ace3bb81a592d9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.333595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4bf38b33364f8bb6ace3bb81a592d9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.334529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4bf38b33364f8bb6ace3bb81a592d9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.335411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4bf38b33364f8bb6ace3bb81a592d9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.344934 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4bf38b33364f8bb6ace3bb81a592d9'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.362187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1227/2466] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:37:48 2022] DELETE /identity/v3/users/ba4bf38b33364f8bb6ace3bb81a592d9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:48.649247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:48.651823 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:48.676635 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c6de8-b462-483e-9191-7cafa419dc02 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:48.733758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:48.734392 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:48.734667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:48.734974 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] PATH_INFO: `/v3/projects/4c0efd9e2ca049bea1e50854dcd985e7` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:48.736189 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0efd9e2ca049bea1e50854dcd985e7)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:48.738141 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:48.792466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0efd9e2ca049bea1e50854dcd985e7', 'request_id': 'req-96983936-c3f6-4de4-865e-efb981ef4f12'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.800467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0efd9e2ca049bea1e50854dcd985e7', 'request_id': 'req-96983936-c3f6-4de4-865e-efb981ef4f12'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.807721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0efd9e2ca049bea1e50854dcd985e7', 'request_id': 'req-96983936-c3f6-4de4-865e-efb981ef4f12'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.818351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] The token cache is being invalidate because project 4c0efd9e2ca049bea1e50854dcd985e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:37:48.818636 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.819370 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:37:48.821239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1240/2467] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:37:48 2022] DELETE /identity/v3/projects/4c0efd9e2ca049bea1e50854dcd985e7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:37:50.818751 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:37:50.820353 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:50.896113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343043-7c9c-4855-87b0-cd2d2874c665 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:37:50.936692 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:50.961615 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641869c-5004-4057-a661-2d1a9950efd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:37:50.962326 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641869c-5004-4057-a661-2d1a9950efd9 service nova] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:37:50.962603 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641869c-5004-4057-a661-2d1a9950efd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:37:50.962907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641869c-5004-4057-a661-2d1a9950efd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:37:50.964723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b641869c-5004-4057-a661-2d1a9950efd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:37:50.977045 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641869c-5004-4057-a661-2d1a9950efd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:37:50.978544 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641869c-5004-4057-a661-2d1a9950efd9 service nova] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:37:50.989258 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1228/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:37:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:37:58.815413 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:00.985160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=15 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:09.054328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:39:09.056415 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:09.074124 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96983936-c3f6-4de4-865e-efb981ef4f12 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:39:09.081615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:39:09.082485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:39:09.082697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:39:09.083167 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:39:09.085252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:09.104876 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:39:09.108894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:39:09.132900 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1241/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:39:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:39:18.770287 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:39:18.770763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:39:18.771110 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:39:18.792949 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] MFA Rules not processed for user `18c2669e28e24bb29a8e57d45dfd3270`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:39:18.794151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:18.858483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1229/2470] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:39:19.119217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:19.164188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:39:19.165731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:19.224217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c48e3c-6729-4355-b998-6639067b7649 service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:39:19.228040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:39:19.228645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:39:19.228916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:39:19.229185 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:39:19.230993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:19.240894 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:39:19.242350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:39:19.250275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1242/2471] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:39:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:39:20.597522 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:39:20.599264 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:20.671325 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db7a53-65c9-42f8-bd22-7590873b48f9 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:39:20.678735 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:39:20.679651 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:39:20.680040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:39:20.680273 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:39:20.682881 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:20.697167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:39:20.699232 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:39:20.710486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1230/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:39:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:39:29.247068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=26 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:30.706501 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=57 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:31.838625 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:39:31.839905 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:31.858222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b701a-93f6-45ce-bca5-1c758fc118e8 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:39:31.864691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfd7db-c171-4ddc-b16d-f25161a52a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:39:31.865313 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd7db-c171-4ddc-b16d-f25161a52a4e service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:39:31.865598 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd7db-c171-4ddc-b16d-f25161a52a4e service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:39:31.865866 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd7db-c171-4ddc-b16d-f25161a52a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:39:31.867762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e7bfd7db-c171-4ddc-b16d-f25161a52a4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:39:31.880978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfd7db-c171-4ddc-b16d-f25161a52a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:39:31.882575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfd7db-c171-4ddc-b16d-f25161a52a4e service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:39:31.893497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1243/2473] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:39:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:39:41.889107 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:40:28.062584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:40:28.064207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:40:28.077939 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7714bc9-298a-4c5d-aa50-2f5f8824c8d3 service placement] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:40:28.084494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:40:28.085104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:40:28.085380 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:40:28.085623 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:40:28.087565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:40:28.099333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:40:28.100909 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:40:28.111052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1231/2474] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:40:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:40:38.106888 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=6 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:40:51.466442 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64dd7c-1acd-4504-a647-0b1f23bb7afc None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:40:51.467011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64dd7c-1acd-4504-a647-0b1f23bb7afc None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:40:51.467119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64dd7c-1acd-4504-a647-0b1f23bb7afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:40:51.487003 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-ae64dd7c-1acd-4504-a647-0b1f23bb7afc None None] MFA Rules not processed for user `18c2669e28e24bb29a8e57d45dfd3270`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:40:51.488214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ae64dd7c-1acd-4504-a647-0b1f23bb7afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:40:51.496821 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1244/2475] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:40:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:40:51.839014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:40:51.854137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e56bca-0e19-45c2-84c1-9076cd699228 service placement] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:40:51.858685 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:40:51.859356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:40:51.859633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:40:51.859897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:40:51.862187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:40:51.872661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:40:51.874071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:40:51.882862 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1232/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:40:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:41:01.482121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:41:01.879153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=6 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:41:02.722914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64dd7c-1acd-4504-a647-0b1f23bb7afc None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:41:02.737023 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64dd7c-1acd-4504-a647-0b1f23bb7afc None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:41:02.743498 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c81304f420a447a1a488a941d4075513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:41:02.744108 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:41:02.744383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:41:02.744661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:41:02.746675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:41:02.757411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:41:02.759028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:41:02.768672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1245/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:41:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:41:12.764269 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=6 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:21.052307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:21.054216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:21.065754 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50044f-78b5-4229-b555-74b7084c7509 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:21.070252 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:21.070856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:21.071169 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:21.071446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:21.073323 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:21.141377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:21.142808 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:21.153024 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1233/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:24.266237 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:24.278757 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e80e-b4a9-44d5-9127-4cfe8fa35d17 service nova] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:24.284911 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:24.285597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:24.285938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:24.286261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:24.288132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:24.301743 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:24.303334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:24.317209 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1246/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:42:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:24.330859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:24.333115 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:24.346724 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899b74-81f4-440f-bcdf-f095d5a27c39 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:24.355832 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:24.356498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:24.356772 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:24.357043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] PATH_INFO: `/v3/users/18c2669e28e24bb29a8e57d45dfd3270` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:24.358290 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c2669e28e24bb29a8e57d45dfd3270)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:24.360263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:24.407257 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c2669e28e24bb29a8e57d45dfd3270'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.413828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c2669e28e24bb29a8e57d45dfd3270'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.414476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c2669e28e24bb29a8e57d45dfd3270'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.415119 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c2669e28e24bb29a8e57d45dfd3270'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.423740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d682c013-97cb-43c8-ada8-755ffb52d7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c2669e28e24bb29a8e57d45dfd3270'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.440653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1234/2480] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:42:24 2022] DELETE /identity/v3/users/18c2669e28e24bb29a8e57d45dfd3270 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:24.625805 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:24.636956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2c34c-8d25-4d7a-82e1-400e0f4fe042 service placement] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:24.695199 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:24.695831 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:24.696101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:24.696366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] PATH_INFO: `/v3/projects/466be70a50e74afd9cd4c7005a0bbe02` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:24.697593 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] RBAC: Authorizing `identity:delete_project(project_id=466be70a50e74afd9cd4c7005a0bbe02)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:24.699590 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:24.745098 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466be70a50e74afd9cd4c7005a0bbe02', 'request_id': 'req-5046a929-43aa-4a00-b2df-20eb5e2a783e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.754538 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466be70a50e74afd9cd4c7005a0bbe02', 'request_id': 'req-5046a929-43aa-4a00-b2df-20eb5e2a783e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.761193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466be70a50e74afd9cd4c7005a0bbe02', 'request_id': 'req-5046a929-43aa-4a00-b2df-20eb5e2a783e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.772620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] The token cache is being invalidate because project 466be70a50e74afd9cd4c7005a0bbe02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:42:24.772934 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.773606 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-5046a929-43aa-4a00-b2df-20eb5e2a783e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:24.775253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1247/2481] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:42:24 2022] DELETE /identity/v3/projects/466be70a50e74afd9cd4c7005a0bbe02 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:24.780718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601075-78b3-4abf-8b2c-f06ca116deec None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:24.781005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601075-78b3-4abf-8b2c-f06ca116deec None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:24.781277 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601075-78b3-4abf-8b2c-f06ca116deec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:24.802182 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-11601075-78b3-4abf-8b2c-f06ca116deec None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:24.803433 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-11601075-78b3-4abf-8b2c-f06ca116deec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:24.866225 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1235/2482] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:24.875978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ebdba-be51-422e-b4f8-498ac8efbd2c None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:24.876145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ebdba-be51-422e-b4f8-498ac8efbd2c None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:24.876522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ebdba-be51-422e-b4f8-498ac8efbd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:24.898669 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-be8ebdba-be51-422e-b4f8-498ac8efbd2c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:24.899908 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-be8ebdba-be51-422e-b4f8-498ac8efbd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:24.908716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1248/2483] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:24.913195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601075-78b3-4abf-8b2c-f06ca116deec None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:24.923574 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601075-78b3-4abf-8b2c-f06ca116deec None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:24.928362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:24.928954 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:24.929216 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:24.929482 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:24.930114 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:42:24.930430 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:24.932019 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:24.933653 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:24.945047 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1236/2484] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:42:24.949956 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ebdba-be51-422e-b4f8-498ac8efbd2c None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:24.960038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ebdba-be51-422e-b4f8-498ac8efbd2c None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:24.965221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:24.965827 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:24.966120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:24.966366 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:24.967092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:24.968996 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:24.998394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1249/2485] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:42:25.002571 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.015347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f5e91-6a25-43b4-9a4a-327b7f30fae2 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.074794 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.075439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.075717 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.076036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.076768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.078682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.101408 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1237/2486] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:42:25 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:42:25.105828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.116836 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b866f8d-f369-40f7-b5a2-f27fc6379fc5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.122093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.122708 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.123021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.123336 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.124059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.125691 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.135701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1250/2487] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:42:25.139728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.150039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a988a6-eb54-4910-a141-5df8fe92a300 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.154916 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9cd34-040a-4499-8aa3-c4405203ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.155543 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9cd34-040a-4499-8aa3-c4405203ff0c admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.155820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9cd34-040a-4499-8aa3-c4405203ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.156091 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9cd34-040a-4499-8aa3-c4405203ff0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.156726 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9cd34-040a-4499-8aa3-c4405203ff0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.158310 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9cd34-040a-4499-8aa3-c4405203ff0c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.169066 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1238/2488] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:42:25.174573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.185278 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c873d6-7e75-41aa-bbbc-6e7b8a2c87df admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.190620 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.191658 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.192050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.192445 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] PATH_INFO: `/v3/projects/654f830a172c40978359b363e9d74a95/users/0f627e0765b94fb5a819752489b6e535/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.210847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654f830a172c40978359b363e9d74a95, user_id=0f627e0765b94fb5a819752489b6e535, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.213641 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.232466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1251/2489] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:42:25 2022] PUT /identity/v3/projects/654f830a172c40978359b363e9d74a95/users/0f627e0765b94fb5a819752489b6e535/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:25.243301 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac896-445e-45a0-a7c0-307d0db2abc8 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.243695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac896-445e-45a0-a7c0-307d0db2abc8 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.243974 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac896-445e-45a0-a7c0-307d0db2abc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.272855 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4efac896-445e-45a0-a7c0-307d0db2abc8 None None] MFA Rules not processed for user `0f627e0765b94fb5a819752489b6e535`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:25.274063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4efac896-445e-45a0-a7c0-307d0db2abc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:25.341343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1239/2490] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:25.346553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.362166 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:25.414217 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23951-2540-4fae-bdfe-2bed6b246f89 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.420422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.421059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.421350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.421608 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.422600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.424630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.454747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1252/2491] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:42:25.459139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac896-445e-45a0-a7c0-307d0db2abc8 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.470851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac896-445e-45a0-a7c0-307d0db2abc8 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.530539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.531183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.531519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.531792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.532418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.534324 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.543377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:25.558955 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1240/2492] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:42:25 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:42:25.563525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.574360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2a94-eacd-43f9-8dd5-99bc2c102259 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.579704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.580301 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.580574 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.580840 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.581505 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.583329 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.594738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1253/2493] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:42:25.599810 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.612585 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53caaa7-9a51-447b-b895-9b098b0f0eb2 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.617708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.618355 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.618633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.618933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] PATH_INFO: `/v3/projects/779d85c60d104c5ab51f2cee12ab2705/users/a758c516560149c6b3a2b7112af2091f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.635330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779d85c60d104c5ab51f2cee12ab2705, user_id=a758c516560149c6b3a2b7112af2091f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.637993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.652806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1241/2494] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:42:25 2022] PUT /identity/v3/projects/779d85c60d104c5ab51f2cee12ab2705/users/a758c516560149c6b3a2b7112af2091f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:42:25.657010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.667454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3eae4-491e-4eab-8c38-dfe9ae572f03 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.724015 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89eb96-d046-4070-8203-7d0f103ebf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.724616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89eb96-d046-4070-8203-7d0f103ebf3f admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.724893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89eb96-d046-4070-8203-7d0f103ebf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.725163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89eb96-d046-4070-8203-7d0f103ebf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.725793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89eb96-d046-4070-8203-7d0f103ebf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.727456 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89eb96-d046-4070-8203-7d0f103ebf3f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.737387 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1254/2495] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:42:25.741768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.752507 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad85d27-ff3d-4a6f-9151-e74a73c66f77 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.757498 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.758190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.758471 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.758746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] PATH_INFO: `/v3/projects/779d85c60d104c5ab51f2cee12ab2705/users/a758c516560149c6b3a2b7112af2091f/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.760787 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779d85c60d104c5ab51f2cee12ab2705, user_id=a758c516560149c6b3a2b7112af2091f, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.763529 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.773813 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1242/2496] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:42:25 2022] PUT /identity/v3/projects/779d85c60d104c5ab51f2cee12ab2705/users/a758c516560149c6b3a2b7112af2091f/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:25.784238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53d792-52ca-419b-8d75-e7d288f47518 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.784524 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53d792-52ca-419b-8d75-e7d288f47518 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.784794 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53d792-52ca-419b-8d75-e7d288f47518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.813441 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-cd53d792-52ca-419b-8d75-e7d288f47518 None None] MFA Rules not processed for user `a758c516560149c6b3a2b7112af2091f`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:25.814633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-cd53d792-52ca-419b-8d75-e7d288f47518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:25.887760 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1255/2497] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:25.900875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:25.902714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:25.961036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d94e-72a0-4bcb-a089-45c484de8919 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:25.965027 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:25.965631 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:25.965907 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:25.966197 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:25.975714 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:25.977137 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:25.986802 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1243/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:42:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:26.071663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53d792-52ca-419b-8d75-e7d288f47518 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:26.081457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53d792-52ca-419b-8d75-e7d288f47518 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:26.085138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945dd5-5fcf-47cb-a7ab-593f3606c9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:26.085742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945dd5-5fcf-47cb-a7ab-593f3606c9dd service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:26.086021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945dd5-5fcf-47cb-a7ab-593f3606c9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:26.086291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945dd5-5fcf-47cb-a7ab-593f3606c9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:26.091452 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:26.146742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54945dd5-5fcf-47cb-a7ab-593f3606c9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:26.148214 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54945dd5-5fcf-47cb-a7ab-593f3606c9dd service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:26.157975 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1256/2499] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:42:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:35.982484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:36.153566 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=24 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:56.129395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:56.201227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2f6d-5895-47b0-ae86-9e10d8c73f84 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:56.206758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:56.207421 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:56.207695 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:56.207961 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] PATH_INFO: `/v3/users/0f627e0765b94fb5a819752489b6e535` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:56.209230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f627e0765b94fb5a819752489b6e535)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:56.211230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:56.262467 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f627e0765b94fb5a819752489b6e535'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.269903 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f627e0765b94fb5a819752489b6e535'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.270518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f627e0765b94fb5a819752489b6e535'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.271270 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f627e0765b94fb5a819752489b6e535'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.280701 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f627e0765b94fb5a819752489b6e535'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.300499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1244/2500] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:42:56 2022] DELETE /identity/v3/users/0f627e0765b94fb5a819752489b6e535 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:56.305207 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:56.305729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:56.305729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:56.326251 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:56.327499 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:56.391810 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1257/2501] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:56.401968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:56.403563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:56.464572 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478b22-fdee-4a6d-a81c-894063140de4 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:56.468833 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:56.469452 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:56.469727 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:56.469998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:56.479697 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:56.481128 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:56.492776 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1245/2502] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:56.770191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:56.771699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:56.784731 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318cd19-9ff2-4fe0-9915-5a817eb799a0 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:56.790263 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:56.791038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:56.791312 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:56.791578 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] PATH_INFO: `/v3/projects/654f830a172c40978359b363e9d74a95` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:56.792804 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=654f830a172c40978359b363e9d74a95)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:56.794981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:56.844561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654f830a172c40978359b363e9d74a95', 'request_id': 'req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.854289 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654f830a172c40978359b363e9d74a95', 'request_id': 'req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.860986 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654f830a172c40978359b363e9d74a95', 'request_id': 'req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.872497 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] The token cache is being invalidate because project 654f830a172c40978359b363e9d74a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:42:56.872784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.873475 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:56.875040 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1258/2503] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:42:56 2022] DELETE /identity/v3/projects/654f830a172c40978359b363e9d74a95 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:56.879412 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:56.889664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795d56-ca09-4897-9e9c-7b312b7ef43b service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:56.909428 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:56.951154 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:56.951792 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:56.952069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:56.952338 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] PATH_INFO: `/v3/users/a758c516560149c6b3a2b7112af2091f` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:56.953518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a758c516560149c6b3a2b7112af2091f)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:56.955487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.005778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a758c516560149c6b3a2b7112af2091f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.013404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a758c516560149c6b3a2b7112af2091f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.014107 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a758c516560149c6b3a2b7112af2091f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.014721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a758c516560149c6b3a2b7112af2091f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.024064 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-3f55686d-9e63-46b7-8172-405925cfd2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a758c516560149c6b3a2b7112af2091f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.041504 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1246/2504] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:42:56 2022] DELETE /identity/v3/users/a758c516560149c6b3a2b7112af2091f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:57.322344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:57.323999 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:57.342410 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e92fa0-5ffe-4e73-ba7c-144ab1d4fd4c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:57.401961 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:57.402516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.402777 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.403112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] PATH_INFO: `/v3/projects/779d85c60d104c5ab51f2cee12ab2705` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.404272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] RBAC: Authorizing `identity:delete_project(project_id=779d85c60d104c5ab51f2cee12ab2705)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:57.406192 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.440417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:57.457436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779d85c60d104c5ab51f2cee12ab2705', 'request_id': 'req-cd5c5a65-eb93-42f2-9581-309ff48f642d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.466323 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779d85c60d104c5ab51f2cee12ab2705', 'request_id': 'req-cd5c5a65-eb93-42f2-9581-309ff48f642d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.472727 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779d85c60d104c5ab51f2cee12ab2705', 'request_id': 'req-cd5c5a65-eb93-42f2-9581-309ff48f642d'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.483279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] The token cache is being invalidate because project 779d85c60d104c5ab51f2cee12ab2705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:42:57.483567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.484239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-cd5c5a65-eb93-42f2-9581-309ff48f642d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:42:57.485770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1259/2505] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:42:57 2022] DELETE /identity/v3/projects/779d85c60d104c5ab51f2cee12ab2705 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:57.491092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a0a67-921d-4a63-b671-e9d46689f57c None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.491573 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a0a67-921d-4a63-b671-e9d46689f57c None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.491682 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a0a67-921d-4a63-b671-e9d46689f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.512616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-8d4a0a67-921d-4a63-b671-e9d46689f57c None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:57.513986 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-8d4a0a67-921d-4a63-b671-e9d46689f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:57.575320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1247/2506] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:57.583943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f4e6-0702-4376-b423-c8fee502b506 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.584225 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f4e6-0702-4376-b423-c8fee502b506 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.584494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f4e6-0702-4376-b423-c8fee502b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.604781 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5935f4e6-0702-4376-b423-c8fee502b506 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:57.605997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5935f4e6-0702-4376-b423-c8fee502b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:57.614561 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1260/2507] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:57.619306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a0a67-921d-4a63-b671-e9d46689f57c None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:57.629743 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a0a67-921d-4a63-b671-e9d46689f57c None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:57.635731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:57.636362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.636630 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.636891 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.637563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:42:57.637861 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:57.639508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.651953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1248/2508] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:42:57.656488 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935f4e6-0702-4376-b423-c8fee502b506 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:57.665955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935f4e6-0702-4376-b423-c8fee502b506 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:57.672055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:57.672660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.672938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.673205 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.673837 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:57.675824 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.707838 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1261/2509] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:42:57 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:42:57.712209 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:57.722354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60937b6f-55dc-4a6b-bf9a-d96692e0313b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:57.748190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:57.780394 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:57.781007 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.781280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.781547 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.782170 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:57.784202 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.808741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1249/2510] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:42:57 2022] POST /identity/v3/users => generated 278 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:42:57.813114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:57.824580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058839f4-2d64-49c4-b70b-f395e6eb3409 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:57.830446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:57.831240 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.831531 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.831801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.832437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:57.834079 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.845038 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1262/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:42:57.850508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:57.866422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282ec72-5a71-40ee-8203-823f6fd413f4 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:57.874495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914270-db29-4db2-b3d4-90067f5542c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:57.875395 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914270-db29-4db2-b3d4-90067f5542c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.875678 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914270-db29-4db2-b3d4-90067f5542c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.875936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914270-db29-4db2-b3d4-90067f5542c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.876823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914270-db29-4db2-b3d4-90067f5542c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:57.878780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914270-db29-4db2-b3d4-90067f5542c7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.890030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1250/2512] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:42:57.894407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:57.905354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17fda-f3ae-4561-b49a-f553877fca43 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:57.911138 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:57.911699 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.911972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.912238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] PATH_INFO: `/v3/projects/d1cf68673a07458cba9446893d405ef3/users/e28cf71dbe8744d49b26ba3a38587c0f/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.927722 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cf68673a07458cba9446893d405ef3, user_id=e28cf71dbe8744d49b26ba3a38587c0f, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:57.930375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:57.946568 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1263/2513] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:42:57 2022] PUT /identity/v3/projects/d1cf68673a07458cba9446893d405ef3/users/e28cf71dbe8744d49b26ba3a38587c0f/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:57.958417 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda666-1d5a-43fd-a7ec-9a16c14706ee None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:57.958699 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda666-1d5a-43fd-a7ec-9a16c14706ee None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:57.959009 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda666-1d5a-43fd-a7ec-9a16c14706ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:57.989531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9ebda666-1d5a-43fd-a7ec-9a16c14706ee None None] MFA Rules not processed for user `e28cf71dbe8744d49b26ba3a38587c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:57.990746 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9ebda666-1d5a-43fd-a7ec-9a16c14706ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:58.055219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1251/2514] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:58.060617 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.127428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4acb7-3125-47c9-8332-dba306d829bd admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.133353 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.133964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.134233 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.134501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.135156 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.137058 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.168500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1264/2515] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:42:58 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:42:58.173094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebda666-1d5a-43fd-a7ec-9a16c14706ee None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.184272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebda666-1d5a-43fd-a7ec-9a16c14706ee None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.241163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.241777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.242056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.242557 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.243233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.245167 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.271204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1252/2516] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:42:58 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:42:58.275326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.286048 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a3510-ff5f-4201-b33d-1f080cbad33e admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.291032 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.291652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.291914 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.292183 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.292819 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.294424 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.305558 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1265/2517] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:42:58.309958 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.320747 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a05c91-bd6b-42d0-b4aa-98df61be51b9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.325777 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.326437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.326712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.327031 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] PATH_INFO: `/v3/projects/dafafffb02034b8e88618fe87851f447/users/b74f7d987354421291bef89dfe55b244/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.343148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafafffb02034b8e88618fe87851f447, user_id=b74f7d987354421291bef89dfe55b244, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.345773 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.360882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1253/2518] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:42:58 2022] PUT /identity/v3/projects/dafafffb02034b8e88618fe87851f447/users/b74f7d987354421291bef89dfe55b244/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:58.365279 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.375711 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5e4c-105c-40ab-9c59-23f74776eacf admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.397014 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:58.436146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0eb5e-3545-4ece-a8c7-4840a2003453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.436676 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0eb5e-3545-4ece-a8c7-4840a2003453 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.436953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0eb5e-3545-4ece-a8c7-4840a2003453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.437224 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0eb5e-3545-4ece-a8c7-4840a2003453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.437853 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0eb5e-3545-4ece-a8c7-4840a2003453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.439506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0eb5e-3545-4ece-a8c7-4840a2003453 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.449273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1266/2519] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:42:58.453637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.460614 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:58.467518 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bf111-7d23-4bab-8434-349d7d75f4ba admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.473212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.473872 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.474143 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.474411 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] PATH_INFO: `/v3/projects/dafafffb02034b8e88618fe87851f447/users/b74f7d987354421291bef89dfe55b244/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.476525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafafffb02034b8e88618fe87851f447, user_id=b74f7d987354421291bef89dfe55b244, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.479190 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.489761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1254/2520] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:42:58 2022] PUT /identity/v3/projects/dafafffb02034b8e88618fe87851f447/users/b74f7d987354421291bef89dfe55b244/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:42:58.499966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c6c99-c32c-42ea-94f9-cb75e800cf48 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.500253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c6c99-c32c-42ea-94f9-cb75e800cf48 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.500529 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c6c99-c32c-42ea-94f9-cb75e800cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.532135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2b3c6c99-c32c-42ea-94f9-cb75e800cf48 None None] MFA Rules not processed for user `b74f7d987354421291bef89dfe55b244`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:42:58.534222 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2b3c6c99-c32c-42ea-94f9-cb75e800cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:58.612460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1267/2521] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:42:58.624429 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.626307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:42:58.685436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51add3a-ed1a-4d09-816c-e0fa82b0f9ec admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.689761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.690448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.690730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.691029 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.700496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.701960 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.712021 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1255/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:42:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:58.795500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c6c99-c32c-42ea-94f9-cb75e800cf48 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:42:58.806412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c6c99-c32c-42ea-94f9-cb75e800cf48 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:42:58.810519 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3268b3-9e07-48f1-bfd3-03837a2bd727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:42:58.811191 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3268b3-9e07-48f1-bfd3-03837a2bd727 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:42:58.811483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3268b3-9e07-48f1-bfd3-03837a2bd727 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:42:58.811705 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3268b3-9e07-48f1-bfd3-03837a2bd727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:42:58.870099 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3268b3-9e07-48f1-bfd3-03837a2bd727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:42:58.872462 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3268b3-9e07-48f1-bfd3-03837a2bd727 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:42:58.887516 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1268/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:42:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:08.707377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:08.880784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=80 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:14.012978 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:14.075044 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a274a6-4d5b-4854-a308-f4f0ca7bedb3 service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:14.079896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:14.080525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:14.080799 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:14.081063 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] PATH_INFO: `/v3/users/e28cf71dbe8744d49b26ba3a38587c0f` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:14.082213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28cf71dbe8744d49b26ba3a38587c0f)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:14.084153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:14.135073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28cf71dbe8744d49b26ba3a38587c0f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.141805 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28cf71dbe8744d49b26ba3a38587c0f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.142465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28cf71dbe8744d49b26ba3a38587c0f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.143099 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28cf71dbe8744d49b26ba3a38587c0f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.152780 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28cf71dbe8744d49b26ba3a38587c0f'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.169499 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1256/2524] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:14 2022] DELETE /identity/v3/users/e28cf71dbe8744d49b26ba3a38587c0f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:14.174262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:14.174759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:14.174893 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:14.194600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:14.195862 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:14.268556 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1269/2525] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:14.278650 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:14.280379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:14.342153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fbc9-7805-49ec-9811-9744487f5770 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:14.346109 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:14.346731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:14.347073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:14.347348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:14.356774 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:14.358213 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:14.367712 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1257/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:14.658602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:14.660144 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:14.678358 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f0f1-13c0-4774-a6f2-788d876ae12f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:14.684181 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:14.684828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:14.685042 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:14.685310 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] PATH_INFO: `/v3/projects/d1cf68673a07458cba9446893d405ef3` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:14.686500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cf68673a07458cba9446893d405ef3)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:14.688476 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:14.737770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cf68673a07458cba9446893d405ef3', 'request_id': 'req-9849b944-31f6-40a8-9d46-6b3782d97559'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.747055 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cf68673a07458cba9446893d405ef3', 'request_id': 'req-9849b944-31f6-40a8-9d46-6b3782d97559'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.754928 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cf68673a07458cba9446893d405ef3', 'request_id': 'req-9849b944-31f6-40a8-9d46-6b3782d97559'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.765369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] The token cache is being invalidate because project d1cf68673a07458cba9446893d405ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:14.765652 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.766332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.767949 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1270/2527] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:14 2022] DELETE /identity/v3/projects/d1cf68673a07458cba9446893d405ef3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:14.772316 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:14.782617 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe8ae-d323-4fe4-8c4d-199eba3f44d0 service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:14.802456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:14.843989 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:14.844664 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:14.844941 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:14.845207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] PATH_INFO: `/v3/users/b74f7d987354421291bef89dfe55b244` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:14.846470 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74f7d987354421291bef89dfe55b244)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:14.848464 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:14.899446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74f7d987354421291bef89dfe55b244'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.907207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74f7d987354421291bef89dfe55b244'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.907979 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74f7d987354421291bef89dfe55b244'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.908645 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74f7d987354421291bef89dfe55b244'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.918463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-9481bd50-f8df-4d34-87d5-440d14e12a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74f7d987354421291bef89dfe55b244'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:14.936328 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1258/2528] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:14 2022] DELETE /identity/v3/users/b74f7d987354421291bef89dfe55b244 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:15.211436 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:15.212926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:15.228828 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849b944-31f6-40a8-9d46-6b3782d97559 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:15.288325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:15.288890 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.289163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.289426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] PATH_INFO: `/v3/projects/dafafffb02034b8e88618fe87851f447` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.290651 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafafffb02034b8e88618fe87851f447)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:15.292758 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:15.338552 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:15.360085 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafafffb02034b8e88618fe87851f447', 'request_id': 'req-da15bea1-1784-41d5-b5ae-6ccbf415014e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:15.369106 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafafffb02034b8e88618fe87851f447', 'request_id': 'req-da15bea1-1784-41d5-b5ae-6ccbf415014e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:15.376201 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafafffb02034b8e88618fe87851f447', 'request_id': 'req-da15bea1-1784-41d5-b5ae-6ccbf415014e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:15.387010 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] The token cache is being invalidate because project dafafffb02034b8e88618fe87851f447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:15.387296 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:15.387926 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-da15bea1-1784-41d5-b5ae-6ccbf415014e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:15.389421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1271/2529] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:15 2022] DELETE /identity/v3/projects/dafafffb02034b8e88618fe87851f447 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:15.394491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04c21-f56a-4e74-9187-5acde51a2707 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.395037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04c21-f56a-4e74-9187-5acde51a2707 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.395224 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04c21-f56a-4e74-9187-5acde51a2707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.415436 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-def04c21-f56a-4e74-9187-5acde51a2707 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:15.416613 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-def04c21-f56a-4e74-9187-5acde51a2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:15.478140 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1259/2530] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:15.486116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b5002-3a42-4071-a80f-9564113c0365 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.486426 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b5002-3a42-4071-a80f-9564113c0365 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.486701 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b5002-3a42-4071-a80f-9564113c0365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.507271 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e87b5002-3a42-4071-a80f-9564113c0365 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:15.508483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e87b5002-3a42-4071-a80f-9564113c0365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:15.518149 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1272/2531] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:15.523148 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def04c21-f56a-4e74-9187-5acde51a2707 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:15.539074 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def04c21-f56a-4e74-9187-5acde51a2707 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:15.546061 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:15.547052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.547337 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.547599 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.548247 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:43:15.548546 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:15.550151 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:15.562764 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1260/2532] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:43:15.569374 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b5002-3a42-4071-a80f-9564113c0365 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:15.583898 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b5002-3a42-4071-a80f-9564113c0365 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:15.591852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:15.592443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.592723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.593007 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.593634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:15.595602 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:15.630807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1273/2533] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:15 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:15.635632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:15.646636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cb7f3-46b3-4772-9f0a-cbbc38484bd6 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:15.673576 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:15.705673 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:15.706281 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.706555 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.706842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.707483 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:15.709447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:15.737871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1261/2534] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:15 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:15.742647 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:15.754344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa610a77-bd3f-4c72-b9b5-00908c08c6d4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:15.759369 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:15.760028 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.760331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.760630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.761260 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:15.762856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:15.773132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1274/2535] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:15.779446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:15.793739 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32d376-6559-4b8d-86b5-ab65ffa80ce5 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:15.800192 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddb7c-5c15-40b6-ae11-93232f1efaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:15.800823 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddb7c-5c15-40b6-ae11-93232f1efaff admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.801095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddb7c-5c15-40b6-ae11-93232f1efaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.801359 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddb7c-5c15-40b6-ae11-93232f1efaff admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.801993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ddb7c-5c15-40b6-ae11-93232f1efaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:15.803668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ddb7c-5c15-40b6-ae11-93232f1efaff admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:15.815068 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1262/2536] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:15.819359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:15.829668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ab9b-1800-4c4f-92ac-34da4f1effb1 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:15.834969 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:15.835615 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.835892 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.836159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] PATH_INFO: `/v3/projects/65e78f76e2e54191ae7ed66f03454e85/users/e4a8b4c030164f298bb91af8194ac9b2/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.851685 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e78f76e2e54191ae7ed66f03454e85, user_id=e4a8b4c030164f298bb91af8194ac9b2, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:15.854383 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:15.871495 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1275/2537] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:15 2022] PUT /identity/v3/projects/65e78f76e2e54191ae7ed66f03454e85/users/e4a8b4c030164f298bb91af8194ac9b2/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:15.938584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0133e-545a-4a6e-8618-54431ec60643 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:15.938904 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0133e-545a-4a6e-8618-54431ec60643 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:15.939244 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0133e-545a-4a6e-8618-54431ec60643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:15.973130 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-4db0133e-545a-4a6e-8618-54431ec60643 None None] MFA Rules not processed for user `e4a8b4c030164f298bb91af8194ac9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:15.974348 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-4db0133e-545a-4a6e-8618-54431ec60643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:16.043307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1263/2538] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:43:16.048412 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.110852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea913141-2ced-4907-8478-1d3d24c7fdd4 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.116004 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.116607 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.116884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.117160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.117788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.119723 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.149784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1276/2539] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:16 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:16.154222 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0133e-545a-4a6e-8618-54431ec60643 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.168122 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0133e-545a-4a6e-8618-54431ec60643 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.227124 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.227737 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.228014 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.228278 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.228914 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.231054 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.255549 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1264/2540] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:16 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:43:16.261261 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.271772 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd70161-4888-4320-93ca-e7e8340c2a2d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.277120 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.277725 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.277987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.278252 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.278924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.280537 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.291943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1277/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:16.298950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.312924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f56b5-6fc3-4dec-a7bf-e330bfbe4109 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.318851 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.319511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.319814 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.320084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] PATH_INFO: `/v3/projects/9ccca127bc4d4026be9561353ab32cfc/users/ae41b0247d994bc0bc005a5a4fbf7ba2/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.336201 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccca127bc4d4026be9561353ab32cfc, user_id=ae41b0247d994bc0bc005a5a4fbf7ba2, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.339035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.355346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1265/2542] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:16 2022] PUT /identity/v3/projects/9ccca127bc4d4026be9561353ab32cfc/users/ae41b0247d994bc0bc005a5a4fbf7ba2/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:16.359610 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.371698 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b367cc-a87d-4344-9319-b84b642dbac6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.394334 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:16.436373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ec8d8-2046-4cac-87d5-92f6dfe479ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.436981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ec8d8-2046-4cac-87d5-92f6dfe479ff admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.437256 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ec8d8-2046-4cac-87d5-92f6dfe479ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.437525 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ec8d8-2046-4cac-87d5-92f6dfe479ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.438164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ec8d8-2046-4cac-87d5-92f6dfe479ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.439889 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ec8d8-2046-4cac-87d5-92f6dfe479ff admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.449884 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1278/2543] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:16.454268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.459817 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:16.466212 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5e1b-f496-4301-af79-ce32e203a56f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.471503 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.472168 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.472447 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.472715 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] PATH_INFO: `/v3/projects/9ccca127bc4d4026be9561353ab32cfc/users/ae41b0247d994bc0bc005a5a4fbf7ba2/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.474654 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccca127bc4d4026be9561353ab32cfc, user_id=ae41b0247d994bc0bc005a5a4fbf7ba2, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.477319 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.487431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1266/2544] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:16 2022] PUT /identity/v3/projects/9ccca127bc4d4026be9561353ab32cfc/users/ae41b0247d994bc0bc005a5a4fbf7ba2/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:16.497793 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0018f6-ad20-47c5-8f02-2adb4b9c768f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.498132 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0018f6-ad20-47c5-8f02-2adb4b9c768f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.498406 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0018f6-ad20-47c5-8f02-2adb4b9c768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.526719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-8b0018f6-ad20-47c5-8f02-2adb4b9c768f None None] MFA Rules not processed for user `ae41b0247d994bc0bc005a5a4fbf7ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:16.527951 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-8b0018f6-ad20-47c5-8f02-2adb4b9c768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:16.599733 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1279/2545] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:16.611363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.613400 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:16.670849 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5831f8f-c41e-439b-87b0-1aa1cd743d78 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.675233 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.675839 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.676117 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.676363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.686204 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.687647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.697162 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1267/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:16.782666 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0018f6-ad20-47c5-8f02-2adb4b9c768f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:16.793494 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0018f6-ad20-47c5-8f02-2adb4b9c768f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:16.797675 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a18622-b547-4c71-b131-244e0cd79052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:16.798274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18622-b547-4c71-b131-244e0cd79052 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:16.798551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18622-b547-4c71-b131-244e0cd79052 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:16.798851 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a18622-b547-4c71-b131-244e0cd79052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:16.856344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a18622-b547-4c71-b131-244e0cd79052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:16.857742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a18622-b547-4c71-b131-244e0cd79052 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:16.867480 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1280/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:19.688373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:19.755788 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b1c5-e3e8-478f-b317-e7c982df448f service cinder] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:19.760496 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:19.761321 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:19.761601 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:19.761871 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] PATH_INFO: `/v3/users/e4a8b4c030164f298bb91af8194ac9b2` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:19.763036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a8b4c030164f298bb91af8194ac9b2)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:19.764933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:19.815016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a8b4c030164f298bb91af8194ac9b2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:19.822473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a8b4c030164f298bb91af8194ac9b2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:19.823231 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a8b4c030164f298bb91af8194ac9b2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:19.824049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a8b4c030164f298bb91af8194ac9b2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:19.833532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a8b4c030164f298bb91af8194ac9b2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:19.850993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1268/2548] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:19 2022] DELETE /identity/v3/users/e4a8b4c030164f298bb91af8194ac9b2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:19.855634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:19.856119 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:19.856219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:19.875439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:19.876603 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:19.919690 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=100 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:19.947865 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1281/2549] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:19.958165 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:19.959822 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:19.974142 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:20.023320 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc313b6-3469-46b4-8380-1ad7e180b2e6 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:20.027592 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:20.028255 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:20.028638 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:20.028910 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:20.039304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:20.040745 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:20.051069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1269/2550] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:20.326024 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:20.328140 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:20.345221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934590b-c837-4286-bc45-56fdb2c6ab09 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:20.350266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:20.350943 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:20.351218 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:20.351483 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] PATH_INFO: `/v3/projects/65e78f76e2e54191ae7ed66f03454e85` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:20.352592 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e78f76e2e54191ae7ed66f03454e85)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:20.354520 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:20.403784 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e78f76e2e54191ae7ed66f03454e85', 'request_id': 'req-ab87bf4a-130d-41cb-9f42-01c3222df0a0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.412825 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e78f76e2e54191ae7ed66f03454e85', 'request_id': 'req-ab87bf4a-130d-41cb-9f42-01c3222df0a0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.420050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e78f76e2e54191ae7ed66f03454e85', 'request_id': 'req-ab87bf4a-130d-41cb-9f42-01c3222df0a0'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.430835 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] The token cache is being invalidate because project 65e78f76e2e54191ae7ed66f03454e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:20.431131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.431776 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.433553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1282/2551] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:20 2022] DELETE /identity/v3/projects/65e78f76e2e54191ae7ed66f03454e85 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:20.437616 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:20.448241 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb8357-092c-4848-b983-50de6d6aedaa service neutron] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:20.508346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:20.508968 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:20.509245 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:20.509511 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] PATH_INFO: `/v3/users/ae41b0247d994bc0bc005a5a4fbf7ba2` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:20.510920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae41b0247d994bc0bc005a5a4fbf7ba2)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:20.513291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:20.576584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae41b0247d994bc0bc005a5a4fbf7ba2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.583980 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae41b0247d994bc0bc005a5a4fbf7ba2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.584749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae41b0247d994bc0bc005a5a4fbf7ba2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.585458 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae41b0247d994bc0bc005a5a4fbf7ba2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.594256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-1b131de7-1f04-4843-8343-0bd81789e9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae41b0247d994bc0bc005a5a4fbf7ba2'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:20.612588 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1270/2552] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:20 2022] DELETE /identity/v3/users/ae41b0247d994bc0bc005a5a4fbf7ba2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:20.908037 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:20.909650 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:20.923614 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bf4a-130d-41cb-9f42-01c3222df0a0 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:20.980467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:20.981097 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:20.981407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:20.981726 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] PATH_INFO: `/v3/projects/9ccca127bc4d4026be9561353ab32cfc` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:20.982868 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ccca127bc4d4026be9561353ab32cfc)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:20.984766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.033121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ccca127bc4d4026be9561353ab32cfc', 'request_id': 'req-846b8e75-59ac-4f50-83a6-78daec8c5c26'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:21.042759 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ccca127bc4d4026be9561353ab32cfc', 'request_id': 'req-846b8e75-59ac-4f50-83a6-78daec8c5c26'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:21.049801 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ccca127bc4d4026be9561353ab32cfc', 'request_id': 'req-846b8e75-59ac-4f50-83a6-78daec8c5c26'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:21.056860 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:21.061964 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] The token cache is being invalidate because project 9ccca127bc4d4026be9561353ab32cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:21.062273 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:21.063112 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-846b8e75-59ac-4f50-83a6-78daec8c5c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:21.065018 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1283/2553] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:20 2022] DELETE /identity/v3/projects/9ccca127bc4d4026be9561353ab32cfc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:21.070583 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c471b3-3767-4238-b9e0-15db50b35357 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.071106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c471b3-3767-4238-b9e0-15db50b35357 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.071207 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c471b3-3767-4238-b9e0-15db50b35357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.098420 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-11c471b3-3767-4238-b9e0-15db50b35357 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:21.099637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-11c471b3-3767-4238-b9e0-15db50b35357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:21.130486 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:21.163628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1271/2554] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:21.173411 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33f7b-d5d4-4cde-9ed7-cbf0c399ea22 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.173695 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33f7b-d5d4-4cde-9ed7-cbf0c399ea22 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.173965 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33f7b-d5d4-4cde-9ed7-cbf0c399ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.194919 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-bde33f7b-d5d4-4cde-9ed7-cbf0c399ea22 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:21.196114 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-bde33f7b-d5d4-4cde-9ed7-cbf0c399ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:21.204511 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1284/2555] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:21.209056 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c471b3-3767-4238-b9e0-15db50b35357 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.219798 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c471b3-3767-4238-b9e0-15db50b35357 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.225318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.225913 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.226181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.226448 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.227116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:43:21.227418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.228996 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.240649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1272/2556] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:43:21.246389 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33f7b-d5d4-4cde-9ed7-cbf0c399ea22 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.255557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33f7b-d5d4-4cde-9ed7-cbf0c399ea22 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.260407 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.261026 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.261294 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.261559 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.262179 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.264145 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.292656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1285/2557] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:21 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:43:21.297307 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.307491 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c04862-1fb9-440e-9abd-a592608648fa admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.371352 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.372008 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.372279 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.372663 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.373306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.375254 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.399440 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1273/2558] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:21 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:21.404236 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.415188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e72d80-32e7-493a-8a0b-c7428dc0c8af admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.420902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.421848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.422121 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.422422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.423064 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.424680 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.434981 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1286/2559] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:21.439263 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.449935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0880d5-9bf1-4b89-9cce-8a2ed14b9cb6 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.455368 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896cdef-c1a3-44e4-8abd-78a5ae199c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.456071 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896cdef-c1a3-44e4-8abd-78a5ae199c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.456373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896cdef-c1a3-44e4-8abd-78a5ae199c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.456642 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896cdef-c1a3-44e4-8abd-78a5ae199c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.457283 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896cdef-c1a3-44e4-8abd-78a5ae199c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.458897 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896cdef-c1a3-44e4-8abd-78a5ae199c12 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.469820 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1274/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:21.474213 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.484664 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78f7c3-504f-4e23-a5e7-8fda48d3cc7c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.490113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.490856 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.491067 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.491339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] PATH_INFO: `/v3/projects/314d0855eaff4c978e67a30df5a5421b/users/6353e1f91ee74d0baf6a075d50070b39/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.506601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314d0855eaff4c978e67a30df5a5421b, user_id=6353e1f91ee74d0baf6a075d50070b39, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.509315 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.524235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1287/2561] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:21 2022] PUT /identity/v3/projects/314d0855eaff4c978e67a30df5a5421b/users/6353e1f91ee74d0baf6a075d50070b39/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:21.534875 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf78f4a-509d-4449-8985-6b608a12eee0 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.535163 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf78f4a-509d-4449-8985-6b608a12eee0 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.535434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf78f4a-509d-4449-8985-6b608a12eee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.565657 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-baf78f4a-509d-4449-8985-6b608a12eee0 None None] MFA Rules not processed for user `6353e1f91ee74d0baf6a075d50070b39`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:21.566942 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-baf78f4a-509d-4449-8985-6b608a12eee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:21.642730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1275/2562] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:21.647417 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.712522 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0431-afcc-4f91-b3ea-9efc720688a9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.717845 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.718446 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.718719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.718978 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.719649 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.721539 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.751557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1288/2563] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:21 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:43:21.755756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf78f4a-509d-4449-8985-6b608a12eee0 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.766719 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf78f4a-509d-4449-8985-6b608a12eee0 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.792661 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:21.826530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.827175 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.827453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.827723 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] PATH_INFO: `/v3/users` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.828356 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.830268 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.853397 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1276/2564] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:21 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:21.857747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.868239 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4c1b2-4847-4736-bbee-046fbbcb0a48 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.873266 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.873855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.874129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.874394 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.875068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.876681 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.887430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1289/2565] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:21.891860 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.902532 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf08c6-e1b9-4097-8f84-dd8272dbe819 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:21.908104 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:21.908779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:21.909055 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:21.909329 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] PATH_INFO: `/v3/projects/8c3d30f49c1544d69fd732a548cd3c2c/users/5ae285f11bbc43c89e4993cc53b3d1b5/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:21.924843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3d30f49c1544d69fd732a548cd3c2c, user_id=5ae285f11bbc43c89e4993cc53b3d1b5, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:21.927527 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:21.944030 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1277/2566] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:21 2022] PUT /identity/v3/projects/8c3d30f49c1544d69fd732a548cd3c2c/users/5ae285f11bbc43c89e4993cc53b3d1b5/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:21.948043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:21.958775 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eab0e-1b80-4b6e-a1d2-9aac77500086 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:22.021729 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b0332-153d-4ecd-8723-2a4f5a4ee199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:22.022254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0332-153d-4ecd-8723-2a4f5a4ee199 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:22.022533 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0332-153d-4ecd-8723-2a4f5a4ee199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:22.022800 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0332-153d-4ecd-8723-2a4f5a4ee199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:22.023534 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b0332-153d-4ecd-8723-2a4f5a4ee199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:22.025130 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b0332-153d-4ecd-8723-2a4f5a4ee199 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:22.034834 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1290/2567] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:22.039360 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:22.051040 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943a45-7f58-419c-afc6-2d66e1512d9b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:22.056534 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:22.057181 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:22.057453 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:22.057722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] PATH_INFO: `/v3/projects/8c3d30f49c1544d69fd732a548cd3c2c/users/5ae285f11bbc43c89e4993cc53b3d1b5/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:22.059852 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3d30f49c1544d69fd732a548cd3c2c, user_id=5ae285f11bbc43c89e4993cc53b3d1b5, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:22.062463 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:22.074125 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1278/2568] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:22 2022] PUT /identity/v3/projects/8c3d30f49c1544d69fd732a548cd3c2c/users/5ae285f11bbc43c89e4993cc53b3d1b5/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:22.084616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4322d5-1b0b-425e-9eab-c0dfc050ea33 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:22.084902 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4322d5-1b0b-425e-9eab-c0dfc050ea33 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:22.085202 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4322d5-1b0b-425e-9eab-c0dfc050ea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:22.093767 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:22.115502 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-5f4322d5-1b0b-425e-9eab-c0dfc050ea33 None None] MFA Rules not processed for user `5ae285f11bbc43c89e4993cc53b3d1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:22.116713 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-5f4322d5-1b0b-425e-9eab-c0dfc050ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:22.200464 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1291/2569] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:22.212626 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:22.214784 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:22.275214 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49762c-7e45-4136-b0b6-6404961a898a admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:22.279333 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb628e39-eec8-4c37-9661-8a4f24a708d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:22.279933 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628e39-eec8-4c37-9661-8a4f24a708d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:22.280206 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628e39-eec8-4c37-9661-8a4f24a708d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:22.280473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628e39-eec8-4c37-9661-8a4f24a708d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:22.290756 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb628e39-eec8-4c37-9661-8a4f24a708d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:22.292205 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb628e39-eec8-4c37-9661-8a4f24a708d7 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:22.302113 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1279/2570] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:22.374575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4322d5-1b0b-425e-9eab-c0dfc050ea33 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:22.443354 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4322d5-1b0b-425e-9eab-c0dfc050ea33 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:22.452082 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:22.452993 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:22.453375 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:22.453704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] PATH_INFO: `/v3/users/6353e1f91ee74d0baf6a075d50070b39` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:22.455633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6353e1f91ee74d0baf6a075d50070b39)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:22.458667 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:22.515128 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6353e1f91ee74d0baf6a075d50070b39'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:22.521962 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6353e1f91ee74d0baf6a075d50070b39'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:22.522633 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6353e1f91ee74d0baf6a075d50070b39'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:22.523297 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6353e1f91ee74d0baf6a075d50070b39'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:22.532184 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6353e1f91ee74d0baf6a075d50070b39'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:22.549930 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1292/2571] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:22 2022] DELETE /identity/v3/users/6353e1f91ee74d0baf6a075d50070b39 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:22.554481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:22.554768 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:22.555078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:22.575362 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:22.576608 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:22.638720 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1280/2572] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:22.651833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:22.653812 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:22.671194 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:22.723059 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfd109-5250-4d9c-859d-3e5aea4e6346 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:22.727813 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:22.728423 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:22.728696 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:22.728966 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:22.739069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:22.740510 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:22.750327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1293/2573] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:23.027767 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:23.029533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:23.041920 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cd59-eb8a-4d51-928c-38b9fcb62dc4 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:23.049334 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:23.050078 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:23.050357 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:23.050622 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] PATH_INFO: `/v3/projects/314d0855eaff4c978e67a30df5a5421b` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:23.052037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] RBAC: Authorizing `identity:delete_project(project_id=314d0855eaff4c978e67a30df5a5421b)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:23.053882 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:23.076582 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:23.105251 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314d0855eaff4c978e67a30df5a5421b', 'request_id': 'req-d962c2ff-cbea-4da0-b847-12f78db8668c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.113346 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314d0855eaff4c978e67a30df5a5421b', 'request_id': 'req-d962c2ff-cbea-4da0-b847-12f78db8668c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.120076 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314d0855eaff4c978e67a30df5a5421b', 'request_id': 'req-d962c2ff-cbea-4da0-b847-12f78db8668c'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.130331 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] The token cache is being invalidate because project 314d0855eaff4c978e67a30df5a5421b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:23.130618 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.131273 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.132816 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1281/2574] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:23 2022] DELETE /identity/v3/projects/314d0855eaff4c978e67a30df5a5421b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:23.136979 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:23.147629 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc27a21-6187-44ea-ab0a-224843165869 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:23.219242 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:23.219879 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:23.220163 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:23.220429 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] PATH_INFO: `/v3/users/5ae285f11bbc43c89e4993cc53b3d1b5` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:23.221580 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae285f11bbc43c89e4993cc53b3d1b5)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:23.223545 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:23.275855 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae285f11bbc43c89e4993cc53b3d1b5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.283146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae285f11bbc43c89e4993cc53b3d1b5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.283817 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae285f11bbc43c89e4993cc53b3d1b5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.284422 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae285f11bbc43c89e4993cc53b3d1b5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.293577 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-eeccb516-2c3d-4597-9ff3-2d298cb35e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae285f11bbc43c89e4993cc53b3d1b5'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.311716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1294/2575] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:23 2022] DELETE /identity/v3/users/5ae285f11bbc43c89e4993cc53b3d1b5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:23.605915 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:23.607889 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:23.620911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962c2ff-cbea-4da0-b847-12f78db8668c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:23.687358 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:23.687917 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:23.688195 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:23.688468 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] PATH_INFO: `/v3/projects/8c3d30f49c1544d69fd732a548cd3c2c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:23.689607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3d30f49c1544d69fd732a548cd3c2c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:23.691552 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:23.739373 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3d30f49c1544d69fd732a548cd3c2c', 'request_id': 'req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.749465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3d30f49c1544d69fd732a548cd3c2c', 'request_id': 'req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.756508 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3d30f49c1544d69fd732a548cd3c2c', 'request_id': 'req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.767344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] The token cache is being invalidate because project 8c3d30f49c1544d69fd732a548cd3c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:23.767633 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.768330 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-8adfcb4e-2b5b-4686-a06e-ae80a66005bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:23.769843 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1282/2576] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:23 2022] DELETE /identity/v3/projects/8c3d30f49c1544d69fd732a548cd3c2c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:23.775050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448f58-a684-4ab1-af92-30bc0844f17f None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:23.775364 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448f58-a684-4ab1-af92-30bc0844f17f None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:23.775637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448f58-a684-4ab1-af92-30bc0844f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:23.795925 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-9e448f58-a684-4ab1-af92-30bc0844f17f None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:23.797437 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-9e448f58-a684-4ab1-af92-30bc0844f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:23.826133 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:23.862311 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1295/2577] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:23.871477 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2930ad2-685a-4a97-ad61-a1ccd761a168 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:23.871762 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2930ad2-685a-4a97-ad61-a1ccd761a168 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:23.872035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2930ad2-685a-4a97-ad61-a1ccd761a168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:23.892318 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-b2930ad2-685a-4a97-ad61-a1ccd761a168 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:23.893530 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-b2930ad2-685a-4a97-ad61-a1ccd761a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:23.902007 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1283/2578] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:23.906719 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448f58-a684-4ab1-af92-30bc0844f17f None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:23.921726 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448f58-a684-4ab1-af92-30bc0844f17f None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:23.930196 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:23.931052 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:23.931420 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:23.931732 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:23.932697 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:43:23.932988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:23.935419 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:23.947332 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1296/2579] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:43:23.951950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2930ad2-685a-4a97-ad61-a1ccd761a168 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:23.961378 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2930ad2-685a-4a97-ad61-a1ccd761a168 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:23.967476 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:23.968087 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:23.968354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:23.968621 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:23.969262 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:23.971211 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.002531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1284/2580] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:23 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:24.006870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.017594 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df679f-4c4f-4cd7-83ad-21233d88a1eb admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.079940 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.080554 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.080864 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.081122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.081745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.083745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.106672 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1297/2581] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:24 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:24.111253 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.121821 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508bd5-bc98-47cd-9e8d-1edee10c1765 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.126854 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.127488 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.127765 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.128036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.128677 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.130280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.132492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:24.143089 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1285/2582] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:24.145944 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.156326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca39785-1a2a-47b5-bfad-2f7a506ba99f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.161113 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28748dbb-c554-471b-be3b-60c2a313db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.161745 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748dbb-c554-471b-be3b-60c2a313db36 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.162020 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748dbb-c554-471b-be3b-60c2a313db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.162291 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748dbb-c554-471b-be3b-60c2a313db36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.162955 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28748dbb-c554-471b-be3b-60c2a313db36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.164597 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28748dbb-c554-471b-be3b-60c2a313db36 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.175157 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1298/2583] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:24.179649 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.190187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ebcb4-f887-400c-b6ef-beea9647c28d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.195105 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.195758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.196037 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.196306 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] PATH_INFO: `/v3/projects/f7e838dbb87f4ce3940f5205aa39a06c/users/26742055e8b44b27b8c13f169986836c/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.212227 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e838dbb87f4ce3940f5205aa39a06c, user_id=26742055e8b44b27b8c13f169986836c, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.214778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.230379 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1286/2584] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:24 2022] PUT /identity/v3/projects/f7e838dbb87f4ce3940f5205aa39a06c/users/26742055e8b44b27b8c13f169986836c/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:24.241195 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b8f2d-747d-4839-8dcb-2d9dbc336dee None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.241485 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b8f2d-747d-4839-8dcb-2d9dbc336dee None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.241755 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b8f2d-747d-4839-8dcb-2d9dbc336dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.270275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-e42b8f2d-747d-4839-8dcb-2d9dbc336dee None None] MFA Rules not processed for user `26742055e8b44b27b8c13f169986836c`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:24.271500 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e42b8f2d-747d-4839-8dcb-2d9dbc336dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:24.350428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1299/2585] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:24.357004 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.426525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb058-10e9-49c4-8c52-55629926e868 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.432612 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.433219 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.433495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.433763 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.434422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.436578 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.466911 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1287/2586] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:24 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:24.471178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b8f2d-747d-4839-8dcb-2d9dbc336dee None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.482403 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b8f2d-747d-4839-8dcb-2d9dbc336dee None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.506496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:24.542501 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.543168 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.543448 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.543718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.544344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.546687 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.568870 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1300/2587] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:24 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:24.572969 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.583559 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255522e-7f83-4cea-aa27-597e1da7c6c9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.588422 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.589020 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.589296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.589563 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.590198 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.591876 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.602434 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1288/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:24.606643 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.617467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a303869-d8f7-4de2-b3d1-cc69f1acb6f6 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.623331 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84f9eb-b74a-4fc1-887f-2fca7b245d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.623938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f9eb-b74a-4fc1-887f-2fca7b245d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.624220 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f9eb-b74a-4fc1-887f-2fca7b245d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.624489 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f9eb-b74a-4fc1-887f-2fca7b245d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.625131 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84f9eb-b74a-4fc1-887f-2fca7b245d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.626739 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84f9eb-b74a-4fc1-887f-2fca7b245d47 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.637327 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1301/2589] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:24.641401 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.651512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1e98-bc09-480a-9ff3-d9c57b446d7b admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.656256 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.656935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.657209 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.657462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] PATH_INFO: `/v3/projects/df4d9123b9af47f48087aa434d0766e5/users/2182b9b3331b4f9d9f89518aeb6ba30e/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.672404 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4d9123b9af47f48087aa434d0766e5, user_id=2182b9b3331b4f9d9f89518aeb6ba30e, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.675049 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.690017 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1289/2590] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:24 2022] PUT /identity/v3/projects/df4d9123b9af47f48087aa434d0766e5/users/2182b9b3331b4f9d9f89518aeb6ba30e/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:24.700360 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2760f2-d53a-4da7-a109-740f9cc8c236 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.700654 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2760f2-d53a-4da7-a109-740f9cc8c236 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.700937 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2760f2-d53a-4da7-a109-740f9cc8c236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.731203 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-be2760f2-d53a-4da7-a109-740f9cc8c236 None None] MFA Rules not processed for user `2182b9b3331b4f9d9f89518aeb6ba30e`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:24.732416 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-be2760f2-d53a-4da7-a109-740f9cc8c236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:24.806790 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1302/2591] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:24.811834 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.888609 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554376c-eb23-44f2-a9b6-70b209efccc8 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.893924 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.894533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.894791 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.895092 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.895731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:24.897628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:24.926183 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1290/2592] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:24 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:24.930325 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2760f2-d53a-4da7-a109-740f9cc8c236 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:24.941542 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2760f2-d53a-4da7-a109-740f9cc8c236 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:24.997198 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:24.997848 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:24.998129 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:24.998380 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:24.999066 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:25.000980 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:25.024326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1303/2593] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:24 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:43:25.028542 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:25.039158 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3338ec-d9ca-4589-8d62-fd47c99840ce admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:25.043987 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:25.044753 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:25.045023 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:25.045308 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:25.045953 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:25.047998 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:25.050111 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:25.065641 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1291/2594] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:25.066833 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:25.077788 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc10c6-74d6-47d2-9e7a-6b1bfee2b06f admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:25.083178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:25.083861 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:25.084135 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:25.084428 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] PATH_INFO: `/v3/projects/d1e92f2162f54122a8a6ae1cfc4d325a/users/e07731f34c314984978231d11af26328/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:25.100093 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e92f2162f54122a8a6ae1cfc4d325a, user_id=e07731f34c314984978231d11af26328, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:25.102724 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:25.115103 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:25.120244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1304/2595] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:25 2022] PUT /identity/v3/projects/d1e92f2162f54122a8a6ae1cfc4d325a/users/e07731f34c314984978231d11af26328/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:25.125294 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:25.140036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d2abb-c865-49cf-bd46-924883f72edd admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:25.198718 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d6225-384f-402d-a9a6-570a9d0397d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:25.199354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6225-384f-402d-a9a6-570a9d0397d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:25.199632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6225-384f-402d-a9a6-570a9d0397d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:25.199895 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6225-384f-402d-a9a6-570a9d0397d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:25.200525 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d6225-384f-402d-a9a6-570a9d0397d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:25.202363 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d6225-384f-402d-a9a6-570a9d0397d2 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:25.212145 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1292/2596] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:25.216567 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:25.227430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e6b16-d795-4985-9232-5198836cf393 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:25.233092 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:25.233748 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:25.234021 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:25.234284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] PATH_INFO: `/v3/projects/d1e92f2162f54122a8a6ae1cfc4d325a/users/e07731f34c314984978231d11af26328/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:25.236432 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e92f2162f54122a8a6ae1cfc4d325a, user_id=e07731f34c314984978231d11af26328, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:25.239101 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:25.249789 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1305/2597] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:25 2022] PUT /identity/v3/projects/d1e92f2162f54122a8a6ae1cfc4d325a/users/e07731f34c314984978231d11af26328/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:25.261628 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:25.261919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:25.262237 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:25.291383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] MFA Rules not processed for user `e07731f34c314984978231d11af26328`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:25.292605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:25.365446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1293/2598] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:25.377063 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:25.379051 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:25.438843 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37c66-685a-44b6-98de-8bd96b599d6d admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:25.442738 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:25.443373 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:25.443656 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:25.443921 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:25.453573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:25.455095 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:25.464991 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1306/2599] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:25.510347 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:25.511828 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:25.524919 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf2d37-5526-4cdf-922e-69a1cf6ab83b None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:25.529519 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5d8a-b5e0-4fe6-b8a0-2b3d89fca144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:25.530126 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5d8a-b5e0-4fe6-b8a0-2b3d89fca144 service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:25.530392 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5d8a-b5e0-4fe6-b8a0-2b3d89fca144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:25.530660 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5d8a-b5e0-4fe6-b8a0-2b3d89fca144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:25.590749 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad5d8a-b5e0-4fe6-b8a0-2b3d89fca144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:25.592366 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad5d8a-b5e0-4fe6-b8a0-2b3d89fca144 service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:25.601510 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1294/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:28.553247 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:28.616188 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c58a88-7eb0-46cf-b2c0-fc2efce67c77 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:28.624244 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:28.625298 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:28.625679 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:28.626050 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] PATH_INFO: `/v3/users/26742055e8b44b27b8c13f169986836c` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:28.627924 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26742055e8b44b27b8c13f169986836c)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:28.630984 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:28.685551 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26742055e8b44b27b8c13f169986836c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:28.692414 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26742055e8b44b27b8c13f169986836c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:28.693070 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26742055e8b44b27b8c13f169986836c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:28.693673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26742055e8b44b27b8c13f169986836c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:28.701274 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26742055e8b44b27b8c13f169986836c'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:28.719762 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1307/2601] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:28 2022] DELETE /identity/v3/users/26742055e8b44b27b8c13f169986836c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:28.724553 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:28.725033 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:28.725132 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:28.745304 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:28.746505 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:28.760032 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=100 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:28.809285 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1295/2602] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:28.819645 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:28.821221 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:28.832430 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:28.885393 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3be4b5-af7c-4eb1-b3ec-3905a5994547 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:28.889359 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:28.889988 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:28.890259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:28.890523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:28.900043 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:28.901486 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:28.911309 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1308/2603] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:29.186036 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:29.187778 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:29.199696 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910bb3c-6d5c-4114-92b8-dfe4aacfaa53 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:29.204842 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:29.205481 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:29.205758 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:29.206043 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] PATH_INFO: `/v3/projects/f7e838dbb87f4ce3940f5205aa39a06c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:29.207415 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e838dbb87f4ce3940f5205aa39a06c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:29.210106 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:29.261218 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e838dbb87f4ce3940f5205aa39a06c', 'request_id': 'req-bd55fecf-e77c-494c-bd4f-d93d31126e12'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.270343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e838dbb87f4ce3940f5205aa39a06c', 'request_id': 'req-bd55fecf-e77c-494c-bd4f-d93d31126e12'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.276877 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e838dbb87f4ce3940f5205aa39a06c', 'request_id': 'req-bd55fecf-e77c-494c-bd4f-d93d31126e12'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.287607 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] The token cache is being invalidate because project f7e838dbb87f4ce3940f5205aa39a06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:29.287896 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.288568 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.290139 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1296/2604] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:29 2022] DELETE /identity/v3/projects/f7e838dbb87f4ce3940f5205aa39a06c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:29.294238 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:29.304563 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a30a80-5b24-4e47-a811-1a1ac01b47c1 service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:29.363350 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:29.364006 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:29.364282 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:29.364553 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] PATH_INFO: `/v3/users/2182b9b3331b4f9d9f89518aeb6ba30e` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:29.365663 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2182b9b3331b4f9d9f89518aeb6ba30e)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:29.367688 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:29.420933 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2182b9b3331b4f9d9f89518aeb6ba30e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.428146 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2182b9b3331b4f9d9f89518aeb6ba30e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.428935 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2182b9b3331b4f9d9f89518aeb6ba30e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.429565 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2182b9b3331b4f9d9f89518aeb6ba30e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.439954 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2182b9b3331b4f9d9f89518aeb6ba30e'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.457689 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1309/2605] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:29 2022] DELETE /identity/v3/users/2182b9b3331b4f9d9f89518aeb6ba30e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 13:43:29.747075 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:29.749035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:29.764230 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fecf-e77c-494c-bd4f-d93d31126e12 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:29.823478 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:29.824116 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:29.824389 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:29.824665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] PATH_INFO: `/v3/projects/df4d9123b9af47f48087aa434d0766e5` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:29.825990 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4d9123b9af47f48087aa434d0766e5)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:29.827929 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:29.873317 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:29.877899 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4d9123b9af47f48087aa434d0766e5', 'request_id': 'req-2bda4e38-b59d-4069-b9a4-6a440b400e65'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.887548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4d9123b9af47f48087aa434d0766e5', 'request_id': 'req-2bda4e38-b59d-4069-b9a4-6a440b400e65'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.894221 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4d9123b9af47f48087aa434d0766e5', 'request_id': 'req-2bda4e38-b59d-4069-b9a4-6a440b400e65'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.904432 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] The token cache is being invalidate because project df4d9123b9af47f48087aa434d0766e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:29.904721 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.905456 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:29.907060 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1297/2606] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:29 2022] DELETE /identity/v3/projects/df4d9123b9af47f48087aa434d0766e5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:29.911228 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:29.912660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:29.926439 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d85d5d-e480-483e-9d2e-de259f355831 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:29.958972 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:29.989343 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:29.989997 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:29.990259 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:29.990528 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] PATH_INFO: `/v3/users/e07731f34c314984978231d11af26328` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:29.991700 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07731f34c314984978231d11af26328)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:29.993637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.043639 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07731f34c314984978231d11af26328'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.051011 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07731f34c314984978231d11af26328'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.051637 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07731f34c314984978231d11af26328'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.052253 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07731f34c314984978231d11af26328'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.059706 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-86eace6b-3c6b-40b0-99ad-d61f15d6a739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07731f34c314984978231d11af26328'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.076618 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1310/2607] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:29 2022] DELETE /identity/v3/users/e07731f34c314984978231d11af26328 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:30.368073 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:30.369605 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:30.387035 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4e38-b59d-4069-b9a4-6a440b400e65 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:30.448539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:30.449187 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.449462 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.449730 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] PATH_INFO: `/v3/projects/d1e92f2162f54122a8a6ae1cfc4d325a` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.450964 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e92f2162f54122a8a6ae1cfc4d325a)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:30.452865 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.503550 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e92f2162f54122a8a6ae1cfc4d325a', 'request_id': 'req-cfacec37-4d8c-43e6-901b-823419053abe'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.512084 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e92f2162f54122a8a6ae1cfc4d325a', 'request_id': 'req-cfacec37-4d8c-43e6-901b-823419053abe'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.519665 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e92f2162f54122a8a6ae1cfc4d325a', 'request_id': 'req-cfacec37-4d8c-43e6-901b-823419053abe'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.530539 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] The token cache is being invalidate because project d1e92f2162f54122a8a6ae1cfc4d325a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:30.530866 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.531512 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-cfacec37-4d8c-43e6-901b-823419053abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:30.533161 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1298/2608] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:30 2022] DELETE /identity/v3/projects/d1e92f2162f54122a8a6ae1cfc4d325a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:30.539471 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120775-1e96-4ba7-9293-c8ce77ab21a9 None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.539721 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120775-1e96-4ba7-9293-c8ce77ab21a9 None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.539987 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120775-1e96-4ba7-9293-c8ce77ab21a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.560303 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-49120775-1e96-4ba7-9293-c8ce77ab21a9 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:30.561477 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-49120775-1e96-4ba7-9293-c8ce77ab21a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:30.621929 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1311/2609] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:30.632490 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9098be-613f-4b80-a0ad-ef51a9a2a159 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.632779 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9098be-613f-4b80-a0ad-ef51a9a2a159 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.633134 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9098be-613f-4b80-a0ad-ef51a9a2a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.656094 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-db9098be-613f-4b80-a0ad-ef51a9a2a159 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:30.657431 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-db9098be-613f-4b80-a0ad-ef51a9a2a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:30.667188 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1299/2610] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:30.672573 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49120775-1e96-4ba7-9293-c8ce77ab21a9 None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:30.688173 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49120775-1e96-4ba7-9293-c8ce77ab21a9 None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:30.694159 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:30.694766 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.695073 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.695342 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.695982 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 13:43:30.696280 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:30.697895 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.711164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1312/2611] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Oct 11 13:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 13:43:30.715722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9098be-613f-4b80-a0ad-ef51a9a2a159 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:30.725487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9098be-613f-4b80-a0ad-ef51a9a2a159 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:30.730584 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:30.731217 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.731492 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.731761 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.732386 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:30.734296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.766291 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1300/2612] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:30 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:43:30.770600 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:30.781216 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995783-0a98-44f1-a6c1-a5ca0e31a2fe admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:30.816454 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:30.842661 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:30.843304 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.843579 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.843847 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.844481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:30.846467 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.870160 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1313/2613] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:30 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:43:30.874686 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:30.891890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f653720-41b9-49a9-adcb-b62fdedba81c admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:30.897856 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:30.898461 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.898741 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.899039 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.899676 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:30.901272 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.912656 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1301/2614] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:30.916967 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:30.928275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57354b69-f4ba-4ba8-93cb-5d319787d1a5 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:30.933478 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79430cf-c146-4220-86b4-9705567f28fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:30.934081 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79430cf-c146-4220-86b4-9705567f28fe admin admin] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.934362 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79430cf-c146-4220-86b4-9705567f28fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.934634 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79430cf-c146-4220-86b4-9705567f28fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.935305 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79430cf-c146-4220-86b4-9705567f28fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:30.936903 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79430cf-c146-4220-86b4-9705567f28fe admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.946881 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1314/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:30.951086 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:30.961450 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772f228-f4df-4eb1-9dfc-7d184a2c158d admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:30.966280 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:30.966950 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:30.967226 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:30.967495 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] PATH_INFO: `/v3/projects/e4d3565100eb4615a8c1d24d92e1477c/users/7c5e0019713041a0a2ca03fed3d38ed9/roles/80afb3528aef4ca38d372f9e8ea1c662` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:30.982668 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3565100eb4615a8c1d24d92e1477c, user_id=7c5e0019713041a0a2ca03fed3d38ed9, role_id=80afb3528aef4ca38d372f9e8ea1c662)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:30.985312 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:30.997693 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:31.006637 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1302/2616] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:30 2022] PUT /identity/v3/projects/e4d3565100eb4615a8c1d24d92e1477c/users/7c5e0019713041a0a2ca03fed3d38ed9/roles/80afb3528aef4ca38d372f9e8ea1c662 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:31.022398 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481da4-62ab-4e25-b1cc-0163663ff86e None None] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.022616 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481da4-62ab-4e25-b1cc-0163663ff86e None None] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.022936 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481da4-62ab-4e25-b1cc-0163663ff86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.052718 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.auth.core [None req-39481da4-62ab-4e25-b1cc-0163663ff86e None None] MFA Rules not processed for user `7c5e0019713041a0a2ca03fed3d38ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:31.054588 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-39481da4-62ab-4e25-b1cc-0163663ff86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:31.122152 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1315/2617] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 13:43:31.126966 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.192733 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6aea4-f668-46a4-add7-404c7bae5cf9 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.197711 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.198315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.198586 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.198859 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] PATH_INFO: `/v3/projects` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.199494 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.201367 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.229935 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1303/2618] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Oct 11 13:43:31 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 13:43:31.234164 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481da4-62ab-4e25-b1cc-0163663ff86e None None] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.245421 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481da4-62ab-4e25-b1cc-0163663ff86e None None] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.303481 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.304009 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.304284 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.304548 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] PATH_INFO: `/v3/users` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.305178 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.307122 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.330953 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1316/2619] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Oct 11 13:43:31 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 13:43:31.335377 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.346446 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8e87c-1326-4e82-8fc6-c038c67bb87f admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.351900 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.352533 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.352806 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.353069 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.353722 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.355383 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.366610 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1304/2620] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 13:43:31.371115 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.381750 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992df1-b21d-48f7-8fbc-9e651e974e28 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.386742 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.387443 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.387716 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.387985 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] PATH_INFO: `/v3/projects/fae43a75a10e4107bd9aa84a416cce07/users/6cc6c850741f4e108c9a629e76aa1866/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.403275 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae43a75a10e4107bd9aa84a416cce07, user_id=6cc6c850741f4e108c9a629e76aa1866, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.405938 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.421704 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1317/2621] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:31 2022] PUT /identity/v3/projects/fae43a75a10e4107bd9aa84a416cce07/users/6cc6c850741f4e108c9a629e76aa1866/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:31.426531 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.440095 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f96d0-7152-4540-8304-81334d51cb2e admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.496632 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a6a8-8ee7-4bc6-8e3f-824d5679862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.497239 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a6a8-8ee7-4bc6-8e3f-824d5679862c admin admin] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.497513 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a6a8-8ee7-4bc6-8e3f-824d5679862c admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.497783 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a6a8-8ee7-4bc6-8e3f-824d5679862c admin admin] PATH_INFO: `/v3/roles` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.498418 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a6a8-8ee7-4bc6-8e3f-824d5679862c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.500062 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a6a8-8ee7-4bc6-8e3f-824d5679862c admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.510354 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1305/2622] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Oct 11 13:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 13:43:31.514989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.526344 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d605-2240-4448-bbfb-608549479ed2 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.531466 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.532193 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.532589 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.532747 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] PATH_INFO: `/v3/projects/fae43a75a10e4107bd9aa84a416cce07/users/6cc6c850741f4e108c9a629e76aa1866/roles/66b14ad5013d4a35a57fd140932b8857` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.534787 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae43a75a10e4107bd9aa84a416cce07, user_id=6cc6c850741f4e108c9a629e76aa1866, role_id=66b14ad5013d4a35a57fd140932b8857)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.537557 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.543262 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:31.550496 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1318/2623] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Oct 11 13:43:31 2022] PUT /identity/v3/projects/fae43a75a10e4107bd9aa84a416cce07/users/6cc6c850741f4e108c9a629e76aa1866/roles/66b14ad5013d4a35a57fd140932b8857 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:31.560936 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155642d6-8a9d-4771-9944-9efebd37e6c7 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.561160 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155642d6-8a9d-4771-9944-9efebd37e6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.561437 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155642d6-8a9d-4771-9944-9efebd37e6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.590344 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-155642d6-8a9d-4771-9944-9efebd37e6c7 None None] MFA Rules not processed for user `6cc6c850741f4e108c9a629e76aa1866`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:31.591595 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-155642d6-8a9d-4771-9944-9efebd37e6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:31.652636 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:31.663672 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1306/2624] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:31.676457 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.678506 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:31.744337 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887da54-9200-4ad2-a97a-6c9d34a57500 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.748460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.749060 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.749341 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.749601 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.759232 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.760660 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.770971 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1319/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:31.870700 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155642d6-8a9d-4771-9944-9efebd37e6c7 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:31.881731 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155642d6-8a9d-4771-9944-9efebd37e6c7 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:31.885831 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167489ec-a1b3-4ab1-a1b3-bfcacbf8dfaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e466d119406f489b962596b7cd9fb7e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:31.886439 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167489ec-a1b3-4ab1-a1b3-bfcacbf8dfaf service cinder] REQUEST_METHOD: `GET` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:31.886713 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167489ec-a1b3-4ab1-a1b3-bfcacbf8dfaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:31.887026 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167489ec-a1b3-4ab1-a1b3-bfcacbf8dfaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:31.945565 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167489ec-a1b3-4ab1-a1b3-bfcacbf8dfaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:31.947022 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167489ec-a1b3-4ab1-a1b3-bfcacbf8dfaf service cinder] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:31.956153 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1307/2626] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:32.234153 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:32.297096 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a685d4-b96b-4984-acfb-902509e0e389 service cinder] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:32.302581 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:32.303235 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:32.303507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:32.303774 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] PATH_INFO: `/v3/users/7c5e0019713041a0a2ca03fed3d38ed9` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:32.304916 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5e0019713041a0a2ca03fed3d38ed9)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:32.306857 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:32.360069 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5e0019713041a0a2ca03fed3d38ed9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.367234 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5e0019713041a0a2ca03fed3d38ed9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.367918 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5e0019713041a0a2ca03fed3d38ed9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.368523 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5e0019713041a0a2ca03fed3d38ed9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.377989 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5e0019713041a0a2ca03fed3d38ed9'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.396025 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1320/2627] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:32 2022] DELETE /identity/v3/users/7c5e0019713041a0a2ca03fed3d38ed9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:32.400619 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] REQUEST_METHOD: `POST` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:32.400906 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:32.401180 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:32.420931 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.auth.core [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] MFA Rules not processed for user `276e27aa2b5a4894a4b0e62293da73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 13:43:32.422487 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:32.485515 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1308/2628] 10.222.0.16 () {58 vars in 958 bytes} [Tue Oct 11 13:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 13:43:32.495797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:32.498219 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:32.521460 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:32.560116 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7cdf6-d330-4c87-a950-cd4d3c7cf8a9 admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:32.564254 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8635b4ce034605bcce301f3f98e721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:32.564796 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:32.565068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:32.565328 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:32.574596 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:32.576080 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:32.585560 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1321/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:43:32.871473 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:32.873018 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:32.887341 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32d52e-dc43-4a09-9245-93012e069a03 None None] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:32.893343 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:32.893981 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:32.894271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:32.894521 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] PATH_INFO: `/v3/projects/e4d3565100eb4615a8c1d24d92e1477c` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:32.895683 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d3565100eb4615a8c1d24d92e1477c)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:32.897606 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:32.948150 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d3565100eb4615a8c1d24d92e1477c', 'request_id': 'req-706822e4-6cd6-454f-8bc1-b3b643b00f91'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.957052 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d3565100eb4615a8c1d24d92e1477c', 'request_id': 'req-706822e4-6cd6-454f-8bc1-b3b643b00f91'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.963667 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d3565100eb4615a8c1d24d92e1477c', 'request_id': 'req-706822e4-6cd6-454f-8bc1-b3b643b00f91'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.974708 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] The token cache is being invalidate because project e4d3565100eb4615a8c1d24d92e1477c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:32.975028 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.975755 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:32.977387 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1309/2630] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:32 2022] DELETE /identity/v3/projects/e4d3565100eb4615a8c1d24d92e1477c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:32.981575 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:32.991807 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76173a65-ca03-4a65-9cdd-8e92521a93ab service neutron] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:33.048339 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:33.048959 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:33.049243 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:33.049507 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] PATH_INFO: `/v3/users/6cc6c850741f4e108c9a629e76aa1866` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:33.050630 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc6c850741f4e108c9a629e76aa1866)` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:33.052585 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:33.106351 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc6c850741f4e108c9a629e76aa1866'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.113797 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc6c850741f4e108c9a629e76aa1866'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.114425 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc6c850741f4e108c9a629e76aa1866'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.115068 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc6c850741f4e108c9a629e76aa1866'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.125852 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.notifications [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc6c850741f4e108c9a629e76aa1866'} {{(pid=81400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.144300 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1322/2631] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:32 2022] DELETE /identity/v3/users/6cc6c850741f4e108c9a629e76aa1866 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:33.428740 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Authenticating user token {{(pid=81401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:43:33.430405 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.fernet_utils [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:43:33.445315 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706822e4-6cd6-454f-8bc1-b3b643b00f91 admin admin] Validating token access rules against request {{(pid=81401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:43:33.458647 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:33.507548 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '276e27aa2b5a4894a4b0e62293da73e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd012bcb449c3476b9eaca11563904099', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:43:33.508194 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:43:33.508465 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:43:33.508728 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] PATH_INFO: `/v3/projects/fae43a75a10e4107bd9aa84a416cce07` {{(pid=81401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:43:33.509890 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae43a75a10e4107bd9aa84a416cce07)` {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:43:33.511847 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] RBAC: Authorization granted {{(pid=81401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:43:33.569993 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae43a75a10e4107bd9aa84a416cce07', 'request_id': 'req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.578097 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae43a75a10e4107bd9aa84a416cce07', 'request_id': 'req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.584698 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae43a75a10e4107bd9aa84a416cce07', 'request_id': 'req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7'} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.595016 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] The token cache is being invalidate because project fae43a75a10e4107bd9aa84a416cce07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 13:43:33.595296 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.596005 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG keystone.notifications [None req-779eb3d9-17b6-4267-aa26-6686b6b8e1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 13:43:33.597484 dv-cinder-850618-5-smb devstack@keystone.service[81401]: [pid: 81401|app: 0|req: 1310/2632] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:33 2022] DELETE /identity/v3/projects/fae43a75a10e4107bd9aa84a416cce07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 13:43:43.140770 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:43.592271 dv-cinder-850618-5-smb devstack@keystone.service[81401]: DEBUG dbcounter [-] [81401] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:35.029075 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Authenticating user token {{(pid=81400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 13:45:35.030668 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:45:35.187609 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370161d-8ccc-4681-9020-f0c13ed5630c admin admin] Validating token access rules against request {{(pid=81400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 13:45:35.247338 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be62ac-7404-4129-9b24-9a058fc08136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0085283bb7642b1a37fbd122831289d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6a9a6f05204b66a90333fa09948687', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 13:45:35.247858 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be62ac-7404-4129-9b24-9a058fc08136 service placement] REQUEST_METHOD: `GET` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 13:45:35.248136 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be62ac-7404-4129-9b24-9a058fc08136 service placement] SCRIPT_NAME: `/identity` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 13:45:35.248399 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be62ac-7404-4129-9b24-9a058fc08136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 13:45:35.250285 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.fernet_utils [None req-c5be62ac-7404-4129-9b24-9a058fc08136 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 13:45:35.262326 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be62ac-7404-4129-9b24-9a058fc08136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 13:45:35.264673 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be62ac-7404-4129-9b24-9a058fc08136 service placement] RBAC: Authorization granted {{(pid=81400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 13:45:35.279272 dv-cinder-850618-5-smb devstack@keystone.service[81400]: [pid: 81400|app: 0|req: 1323/2633] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Oct 11 13:45:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 13:45:45.273768 dv-cinder-850618-5-smb devstack@keystone.service[81400]: DEBUG dbcounter [-] [81400] Writing DB stats keystone:SELECT=89 {{(pid=81400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}